00000001:02000400:1.0F:1790772239.328493:0:2972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1790772256.265658:0:3193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1790772258.452042:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 687 MB/s 00000001:01000000:2.0F:1790772258.702592:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 839 MB/s 00000001:01000000:3.0:1790772258.952604:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3231 MB/s 00000020:02000000:0.0F:1790772259.679840:0:3284:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_4_ge4c1f18 00000400:02000000:3.0:1790772260.429049:0:3299:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.134@tcp [8/256/0/180] 00008000:02000000:3.0:1790772264.280166:0:3449:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790772316.409235:0:5255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790772326.027862:0:5835:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790772326.027870:0:5835:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790772326.028639:0:5835:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cd347c78 00000080:02000400:3.0:1790772326.028651:0:5835:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:3.0:1790772326.035719:0:5835:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1790772326.035733:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790772326.035770:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001e852ab2) 00000020:00000080:3.0:1790772326.035790:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790772326.072783:0:5835:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790772326.074794:0:5835:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790772326.127224:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790772326.127408:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790772326.127430:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790772326.127481:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790772326.127506:0:5835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790772326.127849:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790772326.127856:0:5835:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772326.127865:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be11a7 00000020:01000004:2.0:1790772326.127872:0:5835:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790772326.128034:0:5835:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790772326.128039:0:5835:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cd347c78 from MGS 00000020:01000004:2.0:1790772326.128043:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790772326.128060:0:5835:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fda608c2) 00000020:00000080:2.0:1790772326.128071:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790772326.128404:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd347c78 from MGS, refs=2 00080000:01000000:2.0:1790772326.128411:0:5835:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772326.128417:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be11b5 00000100:00100000:2.0:1790772326.128514:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790772326.128644:0:5835:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790772326.128650:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790772326.129769:0:5835:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790772326.129786:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790772326.131545:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772326.131728:0:5835:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790772326.131734:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790772326.132703:0:5835:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790772326.132711:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790772326.133592:0:5835:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790772326.133601:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790772326.134772:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772326.134776:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772326.134778:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772326.135546:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772326.135549:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772326.135551:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772326.136522:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790772326.148534:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790772326.386312:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1975 MB/s 00000001:01000000:2.0:1790772326.635997:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4003 MB/s 00000001:01000000:3.0:1790772326.886609:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 663 MB/s 00000001:01000000:3.0:1790772327.136059:0:5835:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 927 MB/s 00080000:10000000:3.0:1790772327.150320:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1790772327.171870:0:5835:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790772327.171967:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790772327.171970:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790772327.174820:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790772327.174962:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790772327.175023:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1790772327.175281:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790772327.175308:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790772327.175612:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772327.175766:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790772327.175771:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:2.0:1790772327.181973:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772327.188241:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790772327.188264:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790772327.189606:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790772327.189619:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790772327.190492:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790772327.190513:0:5835:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:0.0:1790772327.190514:0:5835:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790772327.190559:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:0.0:1790772327.190579:0:5835:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (00000000e91884a9) 00000020:00000080:0.0:1790772327.190594:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790772327.190725:0:5835:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000363d29c@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1790772327.190934:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:0.0:1790772327.190941:0:5835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790772327.193022:0:5852:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790772327.193097:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid 12e36d38-efd9-4a85-b7c8-c9520302915a) 00000020:00000080:3.0:1790772327.193116:0:5835:0:(genops.c:1384:class_connect()) connect: client 12e36d38-efd9-4a85-b7c8-c9520302915a, cookie 0xd3c7635991be11c3 00000100:00080000:3.0:1790772327.193127:0:5835:0:(import.c:545:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772327.193134:0:5835:0:(import.c:666:import_select_connection()) MGC192.168.201.134@tcp: import 000000000363d29c using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1790772327.193179:0:5835:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007ced2002 x1877760813301888/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772327.193204:0:5835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS 00000020:01000004:3.0:1790772327.193227:0:5835:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790772327.193262:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790772327.193276:0:5835:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000da311219) 00000020:00000080:3.0:1790772327.193287:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790772327.195079:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ced2002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12e36d38-efd9-4a85-b7c8-c9520302915a:3314:1877760813301888:0@lo:250: 00000100:00100000:0.0:1790772327.195173:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772327.195272:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813301888 00000100:00100000:0.0:1790772327.195281:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813301888 00000100:00100000:0.0:1790772327.195322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772327.195329:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002c8ec86e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1877760813301888:12345-0@lo:250: 00010000:00080000:0.0:1790772327.195353:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 12e36d38-efd9-4a85-b7c8-c9520302915a@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1790772327.195376:0:5848:0:(genops.c:1384:class_connect()) connect: client 12e36d38-efd9-4a85-b7c8-c9520302915a, cookie 0xd3c7635991be11d1 00000100:00080000:0.0:1790772327.195506:0:5848:0:(import.c:65:import_set_state_nolock()) 00000000489d7291 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772327.195555:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002c8ec86e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:3314:x1877760813301888:12345-0@lo:250: Request processed in 226us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772327.195570:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772327.195606:0:3314:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790772327.195615:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:0.0:1790772327.195622:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790772327.195626:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790772327.195629:0:3314:0:(import.c:65:import_set_state_nolock()) 000000000363d29c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790772327.195632:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790772327.195640:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790772327.195645:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ced2002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12e36d38-efd9-4a85-b7c8-c9520302915a:3314:1877760813301888:0@lo:250: 00000100:00080000:1.0:1790772327.198049:0:5851:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1790772327.218484:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.218688:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790772327.218704:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790772327.219808:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790772327.219818:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790772327.222062:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772327.222077:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790772327.222813:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.227655:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790772327.227665:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790772327.228833:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790772327.228844:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790772327.298240:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.298545:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790772327.298552:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790772327.302157:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790772327.302173:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790772327.302947:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.303150:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772327.303156:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790772327.303910:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772327.303917:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790772327.304505:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.304742:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772327.304749:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790772327.309119:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772327.309133:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790772327.309788:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.310020:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772327.310025:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790772327.310755:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772327.310763:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790772327.337353:0:5835:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772327.338565:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790772327.338573:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790772327.342192:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790772327.342214:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790772327.343469:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772327.343491:0:5835:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790772327.345001:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790772327.345028:0:5835:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790772327.345035:0:5835:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790772327.345156:0:5835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790772327.345191:0:5835:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1790772327.345195:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790772327.345197:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772327.345198:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772327.345199:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772327.345200:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772327.345201:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772327.345202:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772327.345203:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772327.345204:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790772327.345205:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790772327.345206:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772327.345208:0:5835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772327.345209:0:5835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1790772327.345211:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772327.345212:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772327.345213:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772327.345213:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772327.345214:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772327.345215:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772327.345216:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772327.345217:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772327.345218:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790772327.345219:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790772327.345219:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772327.345220:0:5835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772327.345272:0:5835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790772327.345293:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000515e7ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302016:0@lo:253: 00000100:00100000:2.0:1790772327.345371:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772327.345492:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302016 00000100:00100000:0.0:1790772327.345499:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302016 00000100:00100000:0.0:1790772327.345541:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772327.345549:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000749b2498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5835:x1877760813302016:12345-0@lo:253: 20000000:01000000:0.0:1790772327.345594:0:5850:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790772327.345597:0:5850:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1790772327.345767:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bdd52b8 going to sleep for 11 seconds 10000000:01000000:1.0:1790772327.353207:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790772327.353609:0:5850:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790772327.358034:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772327.359284:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790772327.359549:0:5850:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790772327.359554:0:5850:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790772327.359558:0:5850:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790772327.359561:0:5850:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790772327.359573:0:5850:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790772327.359771:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772327.360031:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790772327.360043:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790772327.360089:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790772327.360132:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790772327.360180:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790772327.360277:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790772327.360286:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790772327.360415:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790772327.360424:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790772327.360648:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790772327.360658:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790772327.360753:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790772327.360809:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790772327.360842:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790772327.360847:0:5850:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790772327.360860:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772327.361288:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790772327.361299:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790772327.361349:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790772327.361383:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790772327.361432:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790772327.361443:0:5850:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790772327.361518:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790772327.361527:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790772327.361571:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790772327.361606:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790772327.361642:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790772327.361652:0:5850:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790772327.363901:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790772327.363925:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790772327.363964:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790772327.364027:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790772327.364258:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790772327.364307:0:5850:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790772327.364321:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790772327.365534:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790772327.365861:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790772327.365929:0:5850:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.134@tcp for mdt 20000000:01000000:3.0:1790772327.365931:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790772327.365981:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790772327.365990:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790772327.366017:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790772327.366024:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:3.0:1790772327.366064:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790772327.366074:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790772327.366103:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790772327.366136:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790772327.366193:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790772327.366197:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790772327.366202:0:5850:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1790772327.366209:0:5850:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790772327.366840:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1790772327.367059:0:5850:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790772327.375600:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790772327.375674:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1790772327.375751:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1790772327.375772:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790772327.375776:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790772327.375779:0:5850:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790772327.375793:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790772327.375796:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790772327.375825:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790772327.375827:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790772327.376642:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1790772327.376945:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1790772327.376990:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1790772327.377024:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1790772327.377038:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790772327.377040:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790772327.377577:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1790772327.377775:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1790772327.377814:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1790772327.377871:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1790772327.378030:0:5850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790772327.378032:0:5850:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1790772327.378039:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790772327.378062:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378080:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378089:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378094:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378099:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378105:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378128:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f794f80 already unused, calling callback (000000009ee95642) 00010000:00010000:0.0:1790772327.378131:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378138:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378150:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378157:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.378162:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f794f80/0xd3c7635991be11d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772327.378177:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790772327.587868:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000749b2498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5835:x1877760813302016:12345-0@lo:253: Request processed in 242312us (242489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772327.587915:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772327.588056:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000515e7ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302016:0@lo:253: 10000000:01000000:2.0:1790772327.588071:0:5835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790772327.588074:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772327.588076:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772327.588078:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772327.588079:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1790772327.588080:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772327.588081:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772327.588082:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772327.588084:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772327.588086:0:5835:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790772327.588087:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772327.588089:0:5835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772327.588186:0:5835:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cd347c78 from lustre-MDT0000 10000000:01000000:3.0:1790772327.588212:0:5835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790772327.588215:0:5835:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790772327.588219:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff932894b719c0 10000000:01000000:3.0:1790772327.588231:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772327.588251:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff932894b719c0 from 1 10000000:01000000:3.0:1790772327.588255:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790772327.588359:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.588369:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.588379:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772327.588398:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302144:0@lo:101: 00000100:00100000:3.0:1790772327.588455:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.588552:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000001677f4df going to sleep for 11 seconds 00000100:00100000:0.0:1790772327.588642:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302144 00000100:00100000:0.0:1790772327.588649:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302144 00000100:00100000:0.0:1790772327.588725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772327.588734:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007f186375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5835:x1877760813302144:12345-0@lo:101: 00010000:00010000:0.0:1790772327.588746:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772327.588759:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f794f80/0xd3c7635991be11e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be11df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.588780:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f794f80/0xd3c7635991be11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be11df expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.588790:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f794f80/0xd3c7635991be11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be11df expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.588805:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f794f80, rc 0) 00000100:00100000:0.0:1790772327.588842:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007f186375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+6:5835:x1877760813302144:12345-0@lo:101: Request processed in 110us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772327.588848:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772327.588909:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302144:0@lo:101: 00010000:00010000:3.0:1790772327.588921:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.588928:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772327.588970:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302272:0@lo:501: 00000100:00100000:3.0:1790772327.588991:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.589086:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000001677f4df going to sleep for 11 seconds 00000100:00100000:1.0:1790772327.589153:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302272 00000100:00100000:1.0:1790772327.589158:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302272 00000100:00100000:1.0:1790772327.589189:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772327.589195:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f33ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+6:5835:x1877760813302272:12345-0@lo:501: 00000100:00100000:1.0:1790772327.589486:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f33ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+6:5835:x1877760813302272:12345-0@lo:501: Request processed in 292us (494us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772327.589494:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772327.589569:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302272:0@lo:501: 10000000:01000000:3.0:1790772327.589593:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790772327.589610:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.589624:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000005484ddf3/0xd3c7635991be11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772327.589631:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff932891b62000 10000000:01000000:3.0:1790772327.589635:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772327.589638:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff932891b62000 10000000:01000000:3.0:1790772327.589640:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790772327.589643:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff932891b62000 from 1 10000000:01000000:3.0:1790772327.589645:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790772327.589660:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.589666:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.589673:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772327.589683:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302400:0@lo:101: 00000100:00100000:3.0:1790772327.589708:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.589720:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000001677f4df going to sleep for 11 seconds 00000100:00100000:1.0:1790772327.589780:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302400 00000100:00100000:1.0:1790772327.589785:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302400 00000100:00100000:1.0:1790772327.589802:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772327.589807:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009df525a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+6:5835:x1877760813302400:12345-0@lo:101: 00010000:00010000:1.0:1790772327.589814:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772327.589825:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016d0590e/0xd3c7635991be11f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be11ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772327.589849:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016d0590e/0xd3c7635991be11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be11ed expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772327.589857:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016d0590e/0xd3c7635991be11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be11ed expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772327.589864:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016d0590e, rc 0) 00000100:00100000:1.0:1790772327.589918:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009df525a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+7:5835:x1877760813302400:12345-0@lo:101: Request processed in 111us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772327.589924:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772327.589989:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302400:0@lo:101: 00010000:00010000:3.0:1790772327.589998:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.590004:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772327.590023:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790772327.590037:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.590043:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000006a2a9e27/0xd3c7635991be11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772327.590049:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790772327.590052:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772327.590056:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff932891b62000 10000000:01000000:3.0:1790772327.590058:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790772327.590061:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790772327.590063:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790772327.590073:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.590079:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.590085:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772327.590096:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302528:0@lo:101: 00000100:00100000:3.0:1790772327.590119:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.590136:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000001677f4df going to sleep for 11 seconds 00000100:00100000:0.0:1790772327.590184:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302528 00000100:00100000:0.0:1790772327.590188:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302528 00000100:00100000:0.0:1790772327.590205:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772327.590210:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002255a420 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+7:5835:x1877760813302528:12345-0@lo:101: 00010000:00010000:0.0:1790772327.590216:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772327.590223:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000410c83b5/0xd3c7635991be1202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be11fb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.590235:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000410c83b5/0xd3c7635991be1202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be11fb expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.590255:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000410c83b5/0xd3c7635991be1202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be11fb expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772327.590261:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000410c83b5, rc 0) 00000100:00100000:0.0:1790772327.590366:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002255a420 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+8:5835:x1877760813302528:12345-0@lo:101: Request processed in 155us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772327.590372:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790772327.590441:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302528:0@lo:101: 00010000:00010000:3.0:1790772327.590450:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772327.590467:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772327.590500:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302656:0@lo:501: 00000100:00100000:3.0:1790772327.590523:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.590544:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000001677f4df going to sleep for 11 seconds 00000100:00100000:1.0:1790772327.590601:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302656 00000100:00100000:1.0:1790772327.590606:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302656 00000100:00100000:1.0:1790772327.590621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772327.590625:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000af62375f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+8:5835:x1877760813302656:12345-0@lo:501: 00000100:00100000:1.0:1790772327.590791:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000af62375f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5835:x1877760813302656:12345-0@lo:501: Request processed in 165us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772327.590798:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772327.590901:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302656:0@lo:501: 00000100:00100000:3.0:1790772327.590925:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302784:0@lo:503: 00000100:00100000:3.0:1790772327.590960:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.590984:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000001677f4df going to sleep for 11 seconds 00000100:00100000:1.0:1790772327.591033:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302784 00000100:00100000:1.0:1790772327.591037:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302784 00000100:00100000:1.0:1790772327.591095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772327.591101:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000024e47431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5835:x1877760813302784:12345-0@lo:503: 00000100:00100000:1.0:1790772327.591248:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000024e47431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5835:x1877760813302784:12345-0@lo:503: Request processed in 147us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772327.591255:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772327.591325:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813302784:0@lo:503: 00000100:00100000:3.0:1790772327.591538:0:5879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5879:1877760813302912:0@lo:502: 00000100:00100000:3.0:1790772327.591568:0:5879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772327.591758:0:5879:0:(client.c:2716:ptlrpc_set_wait()) set 00000000127e9b60 going to sleep for 11 seconds 00000100:00100000:2.0:1790772327.591801:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813302912 00000100:00100000:2.0:1790772327.591806:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813302912 00000100:00100000:2.0:1790772327.591832:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772327.591837:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000092fe4222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5879:x1877760813302912:12345-0@lo:502: 00000100:00100000:2.0:1790772327.592003:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000092fe4222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5879:x1877760813302912:12345-0@lo:502: Request processed in 166us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772327.592011:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772327.592091:0:5879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5879:1877760813302912:0@lo:502: 00000020:01000000:3.0:1790772327.592112:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772327.592122:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772327.592124:0:5879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790772327.592129:0:5879:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790772327.592132:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790772327.592146:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000435a16f0) 00000020:00000080:3.0:1790772327.592162:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790772327.592167:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790772327.592227:0:5879:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790772327.592233:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be1210 00000020:00000080:3.0:1790772327.592521:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790772327.592532:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772327.592535:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772327.592536:0:5879:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790772327.592539:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772327.592543:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772327.592544:0:5879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790772327.592547:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790772327.592553:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009782545e) 00000020:00000080:3.0:1790772327.592563:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790772327.592567:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790772327.592568:0:5879:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790772327.592571:0:5879:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790772327.592577:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790772327.592618:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd347c78 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790772327.592637:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d6d1c359) 00000020:00000080:3.0:1790772327.592646:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790772327.592707:0:5879:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790772327.592714:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be1225 00000020:00000080:3.0:1790772327.592827:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790772327.592833:0:5879:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790772327.592838:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd3c7635991be122c 00080000:01000000:3.0:1790772327.592843:0:5879:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790772327.592848:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be1233 00080000:10000000:3.0:1790772327.593516:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1790772327.593728:0:5879:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1790772327.597183:0:5879:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790772327.651466:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790772327.651809:0:5879:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790772327.656736:0:5879:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790772327.657069:0:5879:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790772327.699091:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fd8da79e) 00000020:00000080:1.0:1790772327.699114:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790772327.699856:0:5879:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790772327.699915:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be1241 00000020:00000080:1.0:1790772327.712077:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1790772327.714186:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772327.782516:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772327.847505:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772327.896706:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772327.982681:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772328.006107:0:5879:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1790772328.032580:0:5879:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd3c7635991be1248 00000020:00000080:3.0:1790772328.033394:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790772328.033406:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772328.033412:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772328.033415:0:5879:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790772328.033417:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772328.033422:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772328.033423:0:5879:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790772328.033426:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790772328.033460:0:5879:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790772328.033473:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772328.033476:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772328.033477:0:5879:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790772328.033479:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772328.033482:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772328.033483:0:5879:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772328.033486:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772328.033487:0:5879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790772328.033536:0:5879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5879:1877760813303040:0@lo:502: 00000100:00100000:3.0:1790772328.033613:0:5879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772328.033671:0:5879:0:(client.c:2716:ptlrpc_set_wait()) set 00000000127e9b60 going to sleep for 11 seconds 00000100:00100000:0.0:1790772328.034023:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303040 00000100:00100000:0.0:1790772328.034031:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303040 00000100:00100000:0.0:1790772328.034082:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772328.034091:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000057898a05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5879:x1877760813303040:12345-0@lo:502: 00000100:00100000:0.0:1790772328.034691:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000057898a05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5879:x1877760813303040:12345-0@lo:502: Request processed in 600us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772328.034708:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772328.034786:0:5879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c41d9f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5879:1877760813303040:0@lo:502: 00000020:01000000:0.0:1790772328.034816:0:5879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772328.034822:0:5879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772328.034824:0:5879:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790772328.034828:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790772328.035118:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790772328.035137:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790772328.035160:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.035170:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000007a5f894e/0xd3c7635991be11fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772328.035178:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff932891b62000 from 1 10000000:01000000:3.0:1790772328.035180:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772328.035209:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.035223:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.035242:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772328.035257:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b792874 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303168:0@lo:101: 00000100:00100000:3.0:1790772328.035300:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772328.035333:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b8076fc going to sleep for 11 seconds 00000100:00100000:1.0:1790772328.035477:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303168 00000100:00100000:1.0:1790772328.035484:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303168 00000100:00100000:1.0:1790772328.035520:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772328.035528:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000025e86a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:5835:x1877760813303168:12345-0@lo:101: 00010000:00010000:1.0:1790772328.035537:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772328.035549:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be124f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.035568:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be124f expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.035578:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be124f expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.035586:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000082859b0, rc 0) 00000100:00100000:1.0:1790772328.035615:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000025e86a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+10:5835:x1877760813303168:12345-0@lo:101: Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772328.035622:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772328.035729:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b792874 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303168:0@lo:101: 00010000:00010000:3.0:1790772328.035740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.035748:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772328.037467:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b792874 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303296:0@lo:256: 00000100:00100000:3.0:1790772328.037540:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772328.037585:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b8076fc going to sleep for 11 seconds 00000100:00100000:3.0:1790772328.037618:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303296 00000100:00100000:3.0:1790772328.037624:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303296 00000100:00100000:3.0:1790772328.037718:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772328.037727:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b1668fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+10:5835:x1877760813303296:12345-0@lo:256: 20000000:01000000:3.0:1790772328.037748:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790772328.037754:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790772328.037841:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b1668fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+10:5835:x1877760813303296:12345-0@lo:256: Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772328.037860:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772328.039215:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b792874 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303296:0@lo:256: 10000000:01000000:1.0:1790772328.041369:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772328.041430:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.041443:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772328.041469:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891b62000 from 1 10000000:01000000:1.0:1790772328.041472:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772328.041522:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.041529:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.041539:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772328.041557:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303424:0@lo:101: 00000100:00100000:1.0:1790772328.041620:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.041678:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f447ebfa going to sleep for 11 seconds 00000100:00100000:2.0:1790772328.041755:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303424 00000100:00100000:2.0:1790772328.041763:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303424 00000100:00100000:2.0:1790772328.041810:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772328.041818:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007a8dc9bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+10:5835:x1877760813303424:12345-0@lo:101: 00010000:00010000:2.0:1790772328.041835:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772328.041849:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be125d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772328.041896:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be125d expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772328.041906:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be125d expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772328.041914:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085c2d3f1, rc 0) 00000100:00100000:2.0:1790772328.041963:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007a8dc9bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813303424:12345-0@lo:101: Request processed in 145us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772328.041970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772328.042152:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303424:0@lo:101: 00010000:00010000:1.0:1790772328.042165:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.042172:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772328.042224:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303552:0@lo:501: 00000100:00100000:1.0:1790772328.042260:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772328.042491:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303552 00000100:00100000:3.0:1790772328.042497:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303552 00000100:00100000:3.0:1790772328.042523:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772328.042529:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a9deadc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813303552:12345-0@lo:501: 00000100:00100000:1.0:1790772328.042639:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f447ebfa going to sleep for 11 seconds 00000100:00100000:3.0:1790772328.043174:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a9deadc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813303552:12345-0@lo:501: Request processed in 645us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772328.043184:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772328.043363:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303552:0@lo:501: 00000100:00100000:1.0:1790772328.043401:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303680:0@lo:503: 00000100:00100000:1.0:1790772328.043451:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.043480:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f447ebfa going to sleep for 11 seconds 00000100:00100000:2.0:1790772328.043546:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303680 00000100:00100000:2.0:1790772328.043552:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303680 00000100:00100000:2.0:1790772328.043584:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772328.043590:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e480330a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813303680:12345-0@lo:503: 00000040:00080000:2.0:1790772328.043627:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772328.043674:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e480330a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813303680:12345-0@lo:503: Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772328.043680:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772328.043762:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303680:0@lo:503: 00000040:00080000:1.0:1790772328.044787:0:5883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790772328.045270:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790772328.045359:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772328.045409:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772328.045422:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772328.045465:0:5835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790772328.045468:0:5835:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff932891b62000 10000000:01000000:2.0:1790772328.045482:0:5835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff932891b62000 10000000:01000000:2.0:1790772328.045486:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772328.045492:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff932891b62000 from 1 10000000:01000000:2.0:1790772328.045494:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772328.045524:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772328.045532:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772328.045541:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772328.045558:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000515e7ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303808:0@lo:101: 00000100:00100000:2.0:1790772328.045609:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772328.045651:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000006073e93f going to sleep for 11 seconds 00000100:00100000:3.0:1790772328.045716:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303808 00000100:00100000:3.0:1790772328.045723:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303808 00000100:00100000:3.0:1790772328.045764:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772328.045771:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a4be39ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813303808:12345-0@lo:101: 00010000:00010000:3.0:1790772328.045783:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772328.045796:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094ba40e7/0xd3c7635991be1272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be126b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.045818:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094ba40e7/0xd3c7635991be1272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be126b expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.045828:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094ba40e7/0xd3c7635991be1272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be126b expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.045835:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094ba40e7, rc 0) 00000100:00100000:3.0:1790772328.045903:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a4be39ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5835:x1877760813303808:12345-0@lo:101: Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772328.045910:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772328.046099:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000515e7ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303808:0@lo:101: 00010000:00010000:1.0:1790772328.046113:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772328.046121:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772328.046165:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303936:0@lo:501: 00000100:00100000:1.0:1790772328.046190:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.046253:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000451e9d67 going to sleep for 11 seconds 00000100:00100000:3.0:1790772328.046418:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813303936 00000100:00100000:3.0:1790772328.046423:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813303936 00000100:00100000:3.0:1790772328.046490:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772328.046496:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000739beeb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5835:x1877760813303936:12345-0@lo:501: 00000100:00100000:3.0:1790772328.046734:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000739beeb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5835:x1877760813303936:12345-0@lo:501: Request processed in 239us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772328.046742:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772328.046799:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813303936:0@lo:501: 00000100:00100000:1.0:1790772328.046826:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813304064:0@lo:503: 00000100:00100000:1.0:1790772328.046862:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.047102:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000451e9d67 going to sleep for 11 seconds 00000100:00100000:0.0:1790772328.047164:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304064 00000100:00100000:0.0:1790772328.047169:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304064 00000100:00100000:0.0:1790772328.047190:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790772328.047196:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c6de3cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5835:x1877760813304064:12345-0@lo:503: 00000100:00100000:0.0:1790772328.047516:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c6de3cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5835:x1877760813304064:12345-0@lo:503: Request processed in 319us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772328.047524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772328.047666:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813304064:0@lo:503: 00000100:00100000:1.0:1790772328.048639:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5884:1877760813304192:0@lo:502: 00000100:00100000:1.0:1790772328.048688:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.048750:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba6a61ee going to sleep for 11 seconds 00000100:00100000:2.0:1790772328.048780:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304192 00000100:00100000:2.0:1790772328.048787:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304192 00000100:00100000:0.0:1790772328.048836:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790772328.048844:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f1f3c887 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5884:x1877760813304192:12345-0@lo:502: 00000100:00100000:0.0:1790772328.049122:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f1f3c887 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5884:x1877760813304192:12345-0@lo:502: Request processed in 278us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772328.049130:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772328.049294:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5884:1877760813304192:0@lo:502: 00000020:01000004:1.0:1790772328.049349:0:5884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790772328.049363:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000aa7fe17a) 00000020:00000080:1.0:1790772328.049390:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790772328.049463:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd347c78 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790772328.049467:0:5884:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cd347c78 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790772328.049470:0:5884:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cd347c78 4 00010000:00080000:1.0:1790772328.049509:0:5884:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005b4f977f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1790772328.052594:0:5884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1790772328.052848:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790772328.052916:0:5884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790772328.052928:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd3c7635991be1280 00000100:00080000:1.0:1790772328.052937:0:5884:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772328.052948:0:5884:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005b4f977f using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772328.053055:0:5884:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000023a3eaa3 x1877760813304320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772328.053075:0:5884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790772328.053176:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813304320:0@lo:38: 00000100:00100000:0.0:1790772328.053261:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.053801:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304320 00000100:00100000:1.0:1790772328.053810:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304320 00000100:00100000:1.0:1790772328.053850:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772328.053857:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053d5d037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1877760813304320:12345-0@lo:38: 00000100:00100000:1.0:1790772328.053952:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053d5d037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1877760813304320:12345-0@lo:38: Request processed in 94us (691us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790772328.053959:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772328.054167:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772328.054175:0:3314:0:(import.c:65:import_set_state_nolock()) 000000005b4f977f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772328.054179:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790772328.054182:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813304320:0@lo:38: 00000100:00100000:1.0:1790772328.054357:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5884:1877760813304448:0@lo:502: 00000100:00100000:1.0:1790772328.054403:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772328.054434:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304448 00000100:00100000:1.0:1790772328.054438:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304448 00000100:00100000:1.0:1790772328.054462:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772328.054468:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002f3cd92e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5884:x1877760813304448:12345-0@lo:502: 00000100:00100000:1.0:1790772328.054677:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002f3cd92e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5884:x1877760813304448:12345-0@lo:502: Request processed in 210us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772328.054685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772328.054729:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ab28744 going to sleep for 11 seconds 00000100:00100000:1.0:1790772328.054743:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:5884:1877760813304448:0@lo:502: 00000040:00080000:1.0:1790772328.054762:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1790772328.055030:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1790772328.055048:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772328.055064:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.055075:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000f8eef476/0xd3c7635991be126b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790772328.055131:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790772328.055133:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790772328.055135:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772328.055136:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772328.055137:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772328.055138:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772328.055140:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772328.055141:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790772328.055143:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772328.055144:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772328.055146:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772328.055147:0:5835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772328.055150:0:5835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1790772328.055154:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772328.055155:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790772328.055156:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772328.055157:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772328.055158:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772328.055160:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772328.055160:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772328.055161:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790772328.055162:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772328.055163:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772328.055164:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772328.055165:0:5835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772328.055180:0:5835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790772328.055189:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbcbe9d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813304576:0@lo:253: 00000100:00100000:0.0:1790772328.055224:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772328.055257:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000006da20857 going to sleep for 11 seconds 00000100:00100000:0.0:1790772328.055507:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304576 00000100:00100000:0.0:1790772328.055513:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304576 00000100:00100000:0.0:1790772328.055537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772328.055543:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a0f83637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5835:x1877760813304576:12345-0@lo:253: 20000000:01000000:0.0:1790772328.055564:0:5850:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790772328.055586:0:5850:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790772328.091848:0:5850:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790772328.091870:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790772328.091946:0:5871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790772328.091951:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790772328.091972:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.091991:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be124f expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.091998:0:5871:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.092038:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be124f expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772328.092053:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be124f expref: 12 pid: 5848 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772328.092066:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a74f1554 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1877760813304704:0@lo:104: 00000100:00100000:3.0:1790772328.092133:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772328.092195:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 00000000127e9b60 going to sleep for 11 seconds 00000100:00100000:0.0:1790772328.092765:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304704 00000100:00100000:0.0:1790772328.092776:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304704 00000100:00100000:0.0:1790772328.092819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772328.092828:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003ddd9cf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5871:x1877760813304704:12345-0@lo:104: 00010000:00010000:0.0:1790772328.092841:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.092928:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772328.092934:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003ddd9cf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5871:x1877760813304704:12345-0@lo:104: Request processed in 108us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772328.092940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790772328.092964:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772328.092969:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.092976:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1ca14c6 already unused, calling callback (00000000bc73d16c) 10000000:00010000:0.0:1790772328.092979:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.092987:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772328.092993:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772328.092998:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772328.093028:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093050:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772328.093066:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093071:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000f1ca14c6/0xd3c7635991be124f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1256 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093088:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772328.093090:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772328.093091:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772328.093144:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813304832:0@lo:103: 00000100:00100000:0.0:1790772328.093172:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772328.093247:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304832 00000100:00100000:0.0:1790772328.093252:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304832 00010000:00010000:0.0:1790772328.093268:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be124f expref: 13 pid: 5848 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772328.093301:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772328.093308:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000945b21f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3316:x1877760813304832:12345-0@lo:103: 00010000:00010000:0.0:1790772328.093318:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772328.093322:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be124f expref: 13 pid: 5848 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093332:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be124f expref: 13 pid: 5848 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093346:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093363:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772328.093375:0:5840:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001425260s 00010000:00010000:0.0:1790772328.093378:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093384:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093392:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093397:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093402:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5013119 already unused, calling callback (000000009ee95642) 00010000:00010000:0.0:1790772328.093405:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093412:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093419:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093427:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772328.093454:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000945b21f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3316:x1877760813304832:12345-0@lo:103: Request processed in 148us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772328.093460:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772328.093499:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813304832:0@lo:103: 00010000:00010000:0.0:1790772328.093525:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000082859b0/0xd3c7635991be1256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be124f expref: 12 pid: 5848 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772328.093534:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a74f1554 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1877760813304704:0@lo:104: 00010000:00010000:0.0:1790772328.093544:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093551:0:5871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093555:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772328.093559:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5013119/0xd3c7635991be1287 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772328.102173:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a0f83637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5835:x1877760813304576:12345-0@lo:253: Request processed in 46621us (46939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772328.102191:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790772328.102401:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbcbe9d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:5835:1877760813304576:0@lo:253: 10000000:01000000:1.0:1790772328.102420:0:5835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790772328.102423:0:5835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772328.102425:0:5835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790772328.102426:0:5835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772328.102428:0:5835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772328.102429:0:5835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772328.102430:0:5835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772328.102432:0:5835:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790772328.102433:0:5835:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790772328.102435:0:5835:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790772328.102436:0:5835:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790772328.102437:0:5835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772328.102439:0:5835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790772328.102452:0:5835:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790772328.107851:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772328.108397:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772328.108610:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772328.108969:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772328.109171:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772328.109809:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772328.110622:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772328.110898:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772328.111121:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772328.111404:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772328.111596:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772328.112019:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1790772328.156325:0:5835:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1790772328.214012:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790772328.217576:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1790772328.217938:0:5890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1790772328.220409:0:5889:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790772328.220418:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790772328.224764:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790772328.226752:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790772328.227196:0:5835:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790772328.227207:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790772328.227662:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772328.230462:0:5835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790772328.231047:0:5835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790772328.231082:0:5835:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790772328.234590:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790772328.236486:0:5835:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790772328.238612:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790772328.238791:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790772328.238980:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790772328.239168:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790772328.242823:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790772328.243047:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790772328.243191:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790772328.243382:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790772328.243534:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790772328.243693:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1790772328.260332:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1790772328.260685:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790772328.260826:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790772328.261003:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790772328.261154:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790772328.261320:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790772328.261626:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790772328.261758:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790772328.261933:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790772328.262070:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790772328.262220:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790772328.265361:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790772328.265575:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790772328.268208:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790772328.268402:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790772328.268531:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790772328.268683:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790772328.268832:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790772328.269006:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790772328.269133:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790772328.269288:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790772328.269437:0:5835:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790772328.269655:0:5835:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1790772328.323239:0:5890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1790772328.410027:0:5835:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790772328.410064:0:5835:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7e0c1a47988 00100000:10000000:3.0:1790772328.410073:0:5835:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790772328.413592:0:5835:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772328.413607:0:5835:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772328.413620:0:5835:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790772328.413647:0:5835:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1790772328.473459:0:5890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790772328.473542:0:5890:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790772328.473547:0:5890:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790772329.230416:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772330.270693:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772331.275042:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772332.300052:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772332.982746:0:6133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1790772333.261917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790772333.261930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790772333.261932:0:8:0:(import.c:65:import_set_state_nolock()) 000000005b4f977f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772333.261951:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005b4f977f using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1790772333.262022:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017e7f96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813304960:0@lo:400: 00000100:00100000:2.0:1790772333.262092:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772333.262551:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813304960 00000100:00100000:1.0:1790772333.262562:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813304960 00000100:00100000:1.0:1790772333.262607:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772333.262615:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005093afe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:3317:x1877760813304960:12345-0@lo:400: 00000100:00100000:1.0:1790772333.262677:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005093afe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:3317:x1877760813304960:12345-0@lo:400: Request processed in 63us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772333.262685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772333.262732:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017e7f96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813304960:0@lo:400: 00000100:00100000:1.0:1790772333.263379:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000023a3eaa3 x1877760813305088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772333.263409:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813305088:0@lo:38: 00000100:00100000:1.0:1790772333.263444:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772333.263539:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305088 00000100:00100000:0.0:1790772333.263545:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305088 00000100:00100000:0.0:1790772333.263578:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772333.263583:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3e106 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1877760813305088:12345-0@lo:38: 00010000:00080000:0.0:1790772333.263621:0:5857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1790772333.263663:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd3c7635991be128e 00000004:00100000:0.0:1790772333.263709:0:5857:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790772333.263820:0:5857:0:(import.c:65:import_set_state_nolock()) 000000001c9befa1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772333.263868:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3e106 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877760813305088:12345-0@lo:38: Request processed in 284us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772333.263901:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790772333.263935:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000023a3eaa3 x1877760813305088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772333.263949:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790772333.263955:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790772333.263959:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790772333.263962:0:3314:0:(import.c:65:import_set_state_nolock()) 000000005b4f977f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790772333.263967:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023a3eaa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813305088:0@lo:38: 00010000:00010000:1.0:1790772333.323385:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772334.348379:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772335.371256:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772336.395287:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790772337.356430:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790772337.356456:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff932891b62000 from 3 10000000:01000000:1.0:1790772337.356461:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790772337.356508:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772337.356522:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772337.356533:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772337.356557:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c37bf31d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305216:0@lo:101: 00000100:00100000:1.0:1790772337.356626:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772337.356681:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c4a47ba going to sleep for 11 seconds 00000100:00100000:2.0:1790772337.359652:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305216 00000100:00100000:2.0:1790772337.359671:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305216 00000100:00100000:2.0:1790772337.359725:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772337.359734:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c6be2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5852:x1877760813305216:12345-0@lo:101: 00010000:00010000:2.0:1790772337.359752:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772337.359771:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065530b06/0xd3c7635991be129c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1295 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772337.359799:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065530b06/0xd3c7635991be129c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1295 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772337.359809:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065530b06/0xd3c7635991be129c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1295 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772337.359818:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065530b06, rc 0) 00000100:00100000:2.0:1790772337.359910:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c6be2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813305216:12345-0@lo:101: Request processed in 177us (3285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772337.359918:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772337.359977:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c37bf31d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305216:0@lo:101: 00010000:00010000:2.0:1790772337.359994:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772337.360002:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772337.360057:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034da05d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305344:0@lo:256: 00000100:00100000:2.0:1790772337.360102:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772337.360197:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a2f5761 going to sleep for 11 seconds 00000100:00100000:2.0:1790772337.360211:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305344 00000100:00100000:2.0:1790772337.360221:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305344 00000100:00100000:2.0:1790772337.360239:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772337.360244:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008b3711e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813305344:12345-0@lo:256: 20000000:01000000:2.0:1790772337.360256:0:5848:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790772337.360375:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790772337.360377:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790772337.360813:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008b3711e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813305344:12345-0@lo:256: Request processed in 569us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772337.360822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772337.360858:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034da05d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305344:0@lo:256: 10000000:01000000:2.0:1790772337.360911:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790772337.360916:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772337.360924:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000005f53dad6/0xd3c7635991be1295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772337.420587:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790772338.334353:0:6334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd68bbcd40 20000000:00000080:1.0:1790772338.334372:0:6334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9328ba61ec00 uarg=0000000000000000 20000000:01000000:1.0:1790772338.334404:0:6334:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790772338.334410:0:6334:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790772338.334415:0:6334:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790772338.334596:0:6334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790772338.334606:0:6334:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1790772338.341503:0:6334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772338.341848:0:6334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790772338.342066:0:6334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1790772338.342189:0:6334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1790772338.342209:0:6334:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790772338.342231:0:6334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.342251:0:6334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be125d expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.342259:0:6334:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.342311:0:6334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be125d expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.342325:0:6334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be125d expref: 11 pid: 5848 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772338.342340:0:6334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6334:1877760813305472:0@lo:104: 00000100:00100000:0.0:1790772338.342423:0:6334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772338.342535:0:6334:0:(client.c:2716:ptlrpc_set_wait()) set 000000004becb052 going to sleep for 11 seconds 00000100:00100000:2.0:1790772338.342668:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305472 00000100:00100000:2.0:1790772338.342677:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305472 00000100:00100000:2.0:1790772338.345439:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772338.345463:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000016296258 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:6334:x1877760813305472:12345-0@lo:104: 00010000:00010000:2.0:1790772338.345489:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772338.345603:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772338.345608:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000016296258 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:6334:x1877760813305472:12345-0@lo:104: Request processed in 158us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772338.345616:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790772338.345688:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772338.345693:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.345701:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000837eec37 already unused, calling callback (00000000bc73d16c) 10000000:00010000:1.0:1790772338.345704:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.345712:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772338.345727:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772338.345733:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772338.345766:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.345772:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772338.345788:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.345794:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000837eec37/0xd3c7635991be125d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1264 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.345812:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772338.345814:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772338.345815:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772338.345823:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772338.345837:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c46eb1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813305600:0@lo:103: 00000100:00100000:1.0:1790772338.345904:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772338.345955:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305600 00000100:00100000:1.0:1790772338.345962:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305600 00010000:00010000:1.0:1790772338.345985:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be125d expref: 12 pid: 5848 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772338.346009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772338.346015:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f2601a44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3317:x1877760813305600:12345-0@lo:103: 00010000:00010000:1.0:1790772338.346024:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772338.346028:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be125d expref: 12 pid: 5848 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346043:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be125d expref: 12 pid: 5848 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346069:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346076:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346091:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346106:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346112:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346118:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346123:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7893531 already unused, calling callback (000000009ee95642) 00010000:00010000:1.0:1790772338.346126:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346134:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346141:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772338.346161:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772338.346188:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f2601a44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3317:x1877760813305600:12345-0@lo:103: Request processed in 174us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772338.346194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772338.346230:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c46eb1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813305600:0@lo:103: 00010000:00010000:0.0:1790772338.346898:0:6334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085c2d3f1/0xd3c7635991be1264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be125d expref: 11 pid: 5848 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772338.346912:0:6334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6334:1877760813305472:0@lo:104: 00010000:00010000:0.0:1790772338.346926:0:6334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.346935:0:6334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.346941:0:6334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772338.346947:0:6334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7893531/0xd3c7635991be12a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772338.384992:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772338.385017:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034da05d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813305728:0@lo:400: 00000100:00100000:2.0:1790772338.385110:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772338.385173:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305728 00000100:00100000:2.0:1790772338.385180:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305728 00000100:00100000:2.0:1790772338.385222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772338.385229:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000436145a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813305728:12345-0@lo:400: 00000100:00100000:2.0:1790772338.385279:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000436145a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813305728:12345-0@lo:400: Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772338.385286:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790772338.385330:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000034da05d4 x1877760813305728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772338.385343:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034da05d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813305728:0@lo:400: 00010000:00010000:1.0:1790772338.446355:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772339.473241:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772340.493220:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772341.520499:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772342.547474:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790772342.986984:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790772342.986995:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891b62000 from 1 10000000:01000000:3.0:1790772342.987000:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772342.987057:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000002361b678/0xd3c7635991be12aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772342.987071:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000002361b678/0xd3c7635991be12aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772342.987084:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000002361b678/0xd3c7635991be12aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772342.987127:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005749c90e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305856:0@lo:101: 00000100:00100000:3.0:1790772342.987237:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772342.987304:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e117864d going to sleep for 11 seconds 00000100:00100000:1.0:1790772342.987414:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305856 00000100:00100000:1.0:1790772342.987424:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305856 00000100:00100000:1.0:1790772342.987497:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772342.987506:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000088169a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:5852:x1877760813305856:12345-0@lo:101: 00010000:00010000:1.0:1790772342.987524:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772342.987542:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e17507f1/0xd3c7635991be12b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be12aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772342.987571:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e17507f1/0xd3c7635991be12b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be12aa expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772342.987583:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e17507f1/0xd3c7635991be12b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be12aa expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772342.987592:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e17507f1, rc 0) 00000100:00100000:1.0:1790772342.987645:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000088169a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813305856:12345-0@lo:101: Request processed in 139us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772342.987652:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772342.987962:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005749c90e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305856:0@lo:101: 00010000:00010000:0.0:1790772342.987991:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000002361b678/0xd3c7635991be12aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772342.988014:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000002361b678/0xd3c7635991be12aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772342.988084:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305984:0@lo:501: 00000100:00100000:0.0:1790772342.988117:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772342.989063:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 000000000943e533 going to sleep for 11 seconds 00000100:00100000:3.0:1790772342.990148:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813305984 00000100:00100000:3.0:1790772342.990164:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813305984 00000100:00100000:3.0:1790772342.990348:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790772342.990359:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1bf21b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813305984:12345-0@lo:501: 00000100:00100000:3.0:1790772342.993071:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1bf21b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813305984:12345-0@lo:501: Request processed in 2705us (4945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772342.993092:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772343.002714:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813305984:0@lo:501: 00000100:00100000:0.0:1790772343.002813:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813306112:0@lo:503: 00000100:00100000:0.0:1790772343.002947:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772343.003016:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 000000000943e533 going to sleep for 11 seconds 00000100:00100000:1.0:1790772343.003231:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306112 00000100:00100000:1.0:1790772343.003241:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306112 00000100:00100000:1.0:1790772343.003310:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790772343.003320:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003daa53fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813306112:12345-0@lo:503: 00000100:00100000:1.0:1790772343.018763:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003daa53fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813306112:12345-0@lo:503: Request processed in 15432us (15805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772343.018785:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772343.019097:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064907d15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813306112:0@lo:503: 00000100:00100000:3.0:1790772343.038793:0:6574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3deaf05 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6574:1877760813306240:0@lo:502: 00000100:00100000:3.0:1790772343.038961:0:6574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772343.039039:0:6574:0:(client.c:2716:ptlrpc_set_wait()) set 00000000957ac65f going to sleep for 11 seconds 00000100:00100000:0.0:1790772343.039127:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306240 00000100:00100000:0.0:1790772343.039138:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306240 00000100:00100000:0.0:1790772343.039201:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772343.039334:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000485b3ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6574:x1877760813306240:12345-0@lo:502: 00000100:00100000:0.0:1790772343.039762:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000485b3ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6574:x1877760813306240:12345-0@lo:502: Request processed in 433us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772343.039772:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772343.049838:0:6574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3deaf05 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6574:1877760813306240:0@lo:502: 00000020:01000000:3.0:1790772343.050084:0:6574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772343.050098:0:6574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772343.050101:0:6574:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790772343.050112:0:6574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff932891b62000 00000020:00000080:3.0:1790772343.050116:0:6574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772343.050198:0:6574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6574:1877760813306368:0@lo:502: 00000100:00100000:3.0:1790772343.050313:0:6574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772343.050376:0:6574:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772343.050453:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306368 00000100:00100000:0.0:1790772343.050462:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306368 00000100:00100000:0.0:1790772343.050528:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772343.050540:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6574:x1877760813306368:12345-0@lo:502: 00000100:00100000:0.0:1790772343.050854:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6574:x1877760813306368:12345-0@lo:502: Request processed in 314us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772343.050863:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790772343.051183:0:6574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6574:1877760813306368:0@lo:502: 00000020:01000000:2.0:1790772343.051214:0:6574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772343.051221:0:6574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772343.051223:0:6574:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790772343.051228:0:6574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790772343.051430:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790772343.051460:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772343.051473:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772343.051487:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772343.500387:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772343.500424:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813306496:0@lo:400: 00000100:00100000:2.0:1790772343.500534:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772343.500602:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813306624:0@lo:400: 00000100:00100000:2.0:1790772343.500633:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772343.500687:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306624 00000100:00100000:2.0:1790772343.500696:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306624 00000100:00100000:2.0:1790772343.500754:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772343.500779:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813306624:12345-0@lo:400: 00000100:00100000:2.0:1790772343.500847:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813306624:12345-0@lo:400: Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772343.500855:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790772343.500932:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9328b8d69c00 x1877760813306624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772343.500948:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813306624:0@lo:400: 00000100:00100000:0.0:1790772343.501220:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306496 00000100:00100000:0.0:1790772343.501226:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306496 00000100:00100000:0.0:1790772343.501267:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772343.501275:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3315:x1877760813306496:12345-0@lo:400: 00000100:00100000:0.0:1790772343.501328:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3315:x1877760813306496:12345-0@lo:400: Request processed in 54us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772343.501335:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790772343.501427:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813306496:0@lo:400: 00010000:00010000:2.0:1790772343.565305:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772344.587274:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772345.612015:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790772346.575410:0:6701:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790772346.575414:0:6701:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790772346.575540:0:6701:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9328ba5e9800 00000020:01000004:2.0:1790772346.575555:0:6701:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790772346.575566:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790772346.575581:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9328882f3380) 00000020:00000080:2.0:1790772346.575596:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790772346.597824:0:6701:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790772346.600566:0:6701:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:1.0:1790772346.635450:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1790772346.656082:0:6701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1790772346.668866:0:6701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790772346.669463:0:6701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790772346.669526:0:6701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790772346.669554:0:6701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790772346.671320:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790772346.671334:0:6701:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790772346.671352:0:6701:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd3c7635991be12bf 00000020:01000004:1.0:1790772346.671360:0:6701:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1790772346.671385:0:6701:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790772346.671389:0:6701:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790772346.671396:0:6701:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790772346.671400:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790772346.671414:0:6701:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9328ba5f4d40) 00000020:00000080:1.0:1790772346.671425:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1790772346.678124:0:6701:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772346.681226:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790772346.681235:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790772346.689822:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790772346.689837:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790772346.690465:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772346.690474:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790772346.691713:0:6701:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772346.691943:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772346.691949:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790772346.696401:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790772346.696415:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790772346.744691:0:6701:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772346.745689:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790772346.745698:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790772346.750100:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790772346.750118:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790772346.752510:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772346.752532:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790772346.760453:0:6701:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772346.760670:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772346.760675:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790772346.768580:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790772346.768592:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790772346.818134:0:6701:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772346.818345:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772346.818358:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790772346.821725:0:6701:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790772346.821740:0:6701:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790772346.822502:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790772346.822526:0:6701:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1790772346.822532:0:6701:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790772346.857468:0:6701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790772346.857507:0:6701:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1790772346.857510:0:6701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790772346.857512:0:6701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790772346.857513:0:6701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772346.857514:0:6701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772346.857515:0:6701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772346.857517:0:6701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772346.857518:0:6701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772346.857519:0:6701:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772346.857521:0:6701:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772346.857522:0:6701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772346.857523:0:6701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790772346.857527:0:6701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1790772346.857529:0:6701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772346.857530:0:6701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790772346.857535:0:6701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772346.857536:0:6701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772346.857537:0:6701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772346.857538:0:6701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772346.857539:0:6701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772346.857540:0:6701:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772346.857541:0:6701:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772346.857542:0:6701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772346.857543:0:6701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790772346.857568:0:6701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790772346.857591:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813306752:0@lo:253: 00000100:00100000:0.0:1790772346.857666:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772346.857783:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891b1b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772346.857837:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306752 00000100:00100000:3.0:1790772346.857846:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306752 00000100:00100000:3.0:1790772346.860098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772346.860119:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813306752:12345-0@lo:253: 20000000:01000000:3.0:1790772346.860178:0:5849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790772346.860182:0:5849:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790772346.860188:0:5849:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790772346.860191:0:5849:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790772346.861997:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772346.862223:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790772346.862239:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790772346.862277:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790772346.862287:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790772346.862318:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790772346.862380:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790772346.862755:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790772346.862776:0:5849:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:3.0:1790772346.862778:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790772346.862813:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790772346.862822:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790772346.862867:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790772346.862900:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:3.0:1790772346.862947:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790772346.862957:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790772346.862987:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790772346.863038:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1790772346.863725:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790772346.863744:0:5849:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:3.0:1790772346.863746:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790772346.863781:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790772346.863799:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790772346.863836:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790772346.863844:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:3.0:1790772346.868580:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790772346.868614:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790772346.868741:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790772346.868789:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790772346.868814:0:5849:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790772346.868817:0:5849:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790772346.868821:0:5849:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790772346.868835:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790772346.868837:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790772346.868911:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790772346.868914:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790772346.870101:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790772346.870163:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790772346.870230:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790772346.870666:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1790772346.870711:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1790772346.870746:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1790772346.870757:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790772346.870759:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790772346.871563:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790772346.871808:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790772346.871846:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790772346.871946:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1790772346.871973:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790772346.871975:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790772346.872633:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1790772346.872684:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1790772346.872733:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1790772346.872994:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1790772346.873029:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1790772346.873080:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1790772346.873097:0:5849:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1790772346.873100:0:5849:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1790772346.873109:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790772346.873129:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873146:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be11df expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873154:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be11fb expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873160:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be126b expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873169:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873437:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be126b expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873454:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be126b expref: 12 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772346.873479:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba716d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813306880:0@lo:104: 00000100:00100000:1.0:1790772346.873546:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772346.873610:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be11fb expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873619:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be11fb expref: 12 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772346.873627:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba714a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813307008:0@lo:104: 00000100:00100000:1.0:1790772346.873645:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772346.873672:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be11df expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772346.873680:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be11df expref: 12 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772346.873688:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813307136:0@lo:104: 00000100:00100000:1.0:1790772346.873705:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772346.873715:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1767900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772346.873775:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813306880 00000100:00100000:2.0:1790772346.873783:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813306880 00000100:00100000:2.0:1790772346.873816:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307008 00000100:00100000:2.0:1790772346.873819:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307008 00000100:00100000:2.0:1790772346.873827:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307136 00000100:00100000:2.0:1790772346.873829:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307136 00000100:00100000:2.0:1790772346.873841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772346.873850:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5849:x1877760813306880:12345-0@lo:104: 00010000:00010000:2.0:1790772346.873862:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.873961:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772346.873967:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5849:x1877760813306880:12345-0@lo:104: Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772346.873975:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772346.873990:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772346.873996:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+4:5849:x1877760813307008:12345-0@lo:104: 00010000:00010000:2.0:1790772346.874004:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874033:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790772346.874038:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+4:5849:x1877760813307008:12345-0@lo:104: Request processed in 44us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772346.874044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772346.874063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772346.874068:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5849:x1877760813307136:12345-0@lo:104: 00010000:00010000:2.0:1790772346.874076:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874102:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790772346.874106:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5849:x1877760813307136:12345-0@lo:104: Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772346.874111:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790772346.874130:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790772346.874137:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874143:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518200 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772346.874147:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874155:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772346.874161:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772346.874166:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772346.874207:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874215:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772346.874232:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874249:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be126b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1272 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874265:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772346.874268:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874274:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fc400 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772346.874278:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874285:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772346.874291:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772346.874296:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772346.874308:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874315:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772346.874336:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874343:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be11fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1202 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874352:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772346.874360:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874366:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fd000 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772346.874369:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874376:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772346.874383:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772346.874387:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772346.874398:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874404:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772346.874409:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874414:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be11df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be11e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874428:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772346.874430:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772346.874432:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772346.874438:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772346.874456:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813307264:0@lo:103: 00000100:00100000:2.0:1790772346.874484:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772346.874529:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307264 00000100:00100000:2.0:1790772346.874537:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307264 00010000:00010000:2.0:1790772346.874554:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be126b expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772346.874576:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772346.874582:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3318:x1877760813307264:12345-0@lo:103: 00010000:00010000:2.0:1790772346.874591:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772346.874596:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be126b expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874605:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be126b expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.874618:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772346.874643:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3318:x1877760813307264:12345-0@lo:103: Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772346.874650:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772346.874679:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813307264:0@lo:103: 00010000:00010000:1.0:1790772346.875014:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fc200/0xd3c7635991be1272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be126b expref: 12 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772346.875025:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba716d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813306880:0@lo:104: 00000100:00100000:1.0:1790772346.875033:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba714a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813307008:0@lo:104: 00000100:00100000:1.0:1790772346.875039:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813307136:0@lo:104: 00010000:00010000:1.0:1790772346.875056:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772346.875270:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813307392:0@lo:103: 00000100:00100000:2.0:1790772346.875298:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772346.875330:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772346.875336:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813307520:0@lo:103: 00000100:00100000:2.0:1790772346.875354:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772346.875410:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307392 00000100:00100000:0.0:1790772346.875414:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307392 00010000:00010000:0.0:1790772346.875432:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be11fb expref: 12 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772346.875456:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307520 00000100:00100000:0.0:1790772346.875459:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307520 00010000:00010000:0.0:1790772346.875469:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be11df expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772346.875480:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772346.875486:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3315:x1877760813307392:12345-0@lo:103: 00010000:00010000:0.0:1790772346.875493:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772346.875503:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be11fb expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875511:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be11fb expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875522:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030400/0xd3c7635991be1202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be11fb expref: 13 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875533:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772346.875562:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3315:x1877760813307392:12345-0@lo:103: Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772346.875569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772346.875584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772346.875590:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:3315:x1877760813307520:12345-0@lo:103: 00010000:00010000:0.0:1790772346.875599:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772346.875606:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be11df expref: 11 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875614:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be11df expref: 11 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875623:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030600/0xd3c7635991be11e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be11df expref: 11 pid: 5849 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875634:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875642:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875664:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875671:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875678:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875685:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875690:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881681a00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772346.875694:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875701:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875715:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875723:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772346.875746:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+10:3315:x1877760813307520:12345-0@lo:103: Request processed in 157us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772346.875752:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772346.875778:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813307520:0@lo:103: 00000100:00100000:0.0:1790772346.875787:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813307392:0@lo:103: 00010000:00010000:0.0:1790772346.875804:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875820:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.875825:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881681a00/0xd3c7635991be12cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772346.875838:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790772346.973064:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+9:6701:x1877760813306752:12345-0@lo:253: Request processed in 112944us (115388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772346.973079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772346.973378:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813306752:0@lo:253: 10000000:01000000:3.0:1790772346.973396:0:6701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790772346.973400:0:6701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772346.973402:0:6701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772346.973403:0:6701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772346.973404:0:6701:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1790772346.973406:0:6701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772346.973408:0:6701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772346.973409:0:6701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772346.973411:0:6701:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790772346.973413:0:6701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772346.973414:0:6701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772346.973435:0:6701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9328ba5e9800 from lustre-OST0000 10000000:01000000:3.0:1790772346.973458:0:6701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790772346.973461:0:6701:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790772346.973481:0:6701:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff932894b719c0 local copy 10000000:01000000:3.0:1790772346.973485:0:6701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790772346.973524:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.973535:0:6701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.973545:0:6701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772346.973563:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813307648:0@lo:101: 00000100:00100000:3.0:1790772346.973599:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772346.973662:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772346.973793:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307648 00000100:00100000:0.0:1790772346.973801:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307648 00000100:00100000:0.0:1790772346.973846:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772346.973855:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:6701:x1877760813307648:12345-0@lo:101: 00010000:00010000:0.0:1790772346.973868:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772346.973924:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030600/0xd3c7635991be12db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be12d4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.974074:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030600/0xd3c7635991be12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be12d4 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.974086:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030600/0xd3c7635991be12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be12d4 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.974095:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030600, rc 0) 00000100:00100000:0.0:1790772346.974137:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+10:6701:x1877760813307648:12345-0@lo:101: Request processed in 283us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772346.974143:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772346.974555:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813307648:0@lo:101: 00010000:00010000:3.0:1790772346.974570:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.974579:0:6701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772346.974672:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813307776:0@lo:501: 00000100:00100000:3.0:1790772346.974699:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772346.974774:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772346.979847:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307776 00000100:00100000:1.0:1790772346.979864:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307776 00000100:00100000:0.0:1790772346.980082:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772346.980092:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+10:6701:x1877760813307776:12345-0@lo:501: 00000100:00100000:0.0:1790772346.980387:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+10:6701:x1877760813307776:12345-0@lo:501: Request processed in 296us (5686us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772346.980401:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790772346.980505:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813307776:0@lo:501: 10000000:01000000:3.0:1790772346.980529:0:6701:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790772346.980562:0:6701:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790772346.980570:0:6701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.980586:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.980594:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.980619:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790772346.980642:0:6701:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9328ba5e9800 10000000:01000000:3.0:1790772346.980646:0:6701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772346.980651:0:6701:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff932894b719c0 10000000:01000000:3.0:1790772346.980654:0:6701:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790772346.980657:0:6701:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff932894b719c0 from 1 10000000:01000000:3.0:1790772346.980660:0:6701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790772346.980690:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.980699:0:6701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.980707:0:6701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772346.980724:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813307904:0@lo:101: 00000100:00100000:3.0:1790772346.980756:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772346.980792:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0900 going to sleep for 11 seconds 00010000:00010000:0.0:1790772346.980985:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772346.980992:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.980999:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fc200 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772346.981003:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981012:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772346.981019:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772346.981025:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772346.981045:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981052:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772346.981081:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981087:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fc200/0xd3c7635991be12d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd3c7635991be12db expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981102:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772346.981103:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772346.981105:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772346.981112:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772346.981131:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813308032:0@lo:103: 00000100:00100000:0.0:1790772346.981158:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772346.981373:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308032 00000100:00100000:0.0:1790772346.981380:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308032 00000100:00100000:0.0:1790772346.981421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772346.981429:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+10:3318:x1877760813308032:12345-0@lo:103: 00010000:00010000:0.0:1790772346.981439:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772346.981452:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030600/0xd3c7635991be12db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be12d4 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981466:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772346.981498:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:3318:x1877760813308032:12345-0@lo:103: Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772346.981505:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772346.981540:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813308032:0@lo:103: 00000100:00100000:0.0:1790772346.981558:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813307904 00000100:00100000:0.0:1790772346.981561:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813307904 00000100:00100000:0.0:1790772346.981581:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790772346.981587:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+9:6701:x1877760813307904:12345-0@lo:101: 00010000:00010000:0.0:1790772346.981597:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772346.981608:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030400/0xd3c7635991be12e9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be12e2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981628:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030400/0xd3c7635991be12e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be12e2 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981638:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030400/0xd3c7635991be12e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be12e2 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772346.981655:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030400, rc 0) 00000100:00100000:0.0:1790772346.981683:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+10:6701:x1877760813307904:12345-0@lo:101: Request processed in 97us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772346.981689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790772346.981768:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813307904:0@lo:101: 00010000:00010000:3.0:1790772346.981782:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.981803:0:6701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772346.981821:0:6701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790772346.981838:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.981845:0:6701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772346.981852:0:6701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790772346.981856:0:6701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772346.981862:0:6701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790772346.981865:0:6701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790772346.981915:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.981923:0:6701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.981931:0:6701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772346.981954:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308160:0@lo:101: 00000100:00100000:3.0:1790772346.981979:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772346.981999:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772346.982113:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308160 00000100:00100000:2.0:1790772346.982118:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308160 00000100:00100000:2.0:1790772346.982153:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772346.982161:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+10:6701:x1877760813308160:12345-0@lo:101: 00010000:00010000:2.0:1790772346.982168:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772346.982183:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be12f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.982211:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.982220:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772346.982227:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518200, rc 0) 00000100:00100000:2.0:1790772346.982257:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308160:12345-0@lo:101: Request processed in 97us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772346.982263:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772346.982493:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308160:0@lo:101: 00010000:00010000:3.0:1790772346.982504:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772346.982517:0:6701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772346.982598:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308288:0@lo:501: 00000100:00100000:3.0:1790772346.982636:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772346.982658:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772346.982672:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308288 00000100:00100000:3.0:1790772346.982676:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308288 00000100:00100000:3.0:1790772346.982702:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772346.982709:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308288:12345-0@lo:501: 00000100:00100000:3.0:1790772346.982956:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308288:12345-0@lo:501: Request processed in 236us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772346.982965:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772346.982997:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308288:0@lo:501: 00000100:00100000:3.0:1790772346.983024:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308416:0@lo:503: 00000100:00100000:3.0:1790772346.983059:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772346.983073:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772346.983085:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308416 00000100:00100000:3.0:1790772346.983089:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308416 00000100:00100000:3.0:1790772346.983104:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790772346.983109:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308416:12345-0@lo:503: 00000100:00100000:3.0:1790772346.983563:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308416:12345-0@lo:503: Request processed in 451us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772346.983570:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772346.983658:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308416:0@lo:503: 00000040:00080000:0.0:1790772346.984164:0:6701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772346.984504:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308544:0@lo:502: 00000100:00100000:0.0:1790772346.984558:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772346.984598:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891b1be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772346.984679:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308544 00000100:00100000:2.0:1790772346.984685:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308544 00000100:00100000:2.0:1790772346.984716:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790772346.984724:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308544:12345-0@lo:502: 00000100:00100000:2.0:1790772346.984957:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308544:12345-0@lo:502: Request processed in 225us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772346.984965:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790772346.985328:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308544:0@lo:502: 00000040:00080000:0.0:1790772346.985590:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790772346.985643:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790772346.985679:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790772346.985725:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790772346.985763:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790772346.985798:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790772346.985824:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308672:0@lo:502: 00000100:00100000:0.0:1790772346.985867:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772346.986123:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891b1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772346.988641:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308672 00000100:00100000:3.0:1790772346.988670:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308672 00000100:00100000:3.0:1790772346.988731:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790772346.988741:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308672:12345-0@lo:502: 00000100:00100000:3.0:1790772346.989162:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308672:12345-0@lo:502: Request processed in 422us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772346.989171:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790772346.989378:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308672:0@lo:502: 00000040:00080000:0.0:1790772346.989529:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790772346.989546:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1790772346.991270:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790772346.991281:0:6720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790772346.991288:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772346.991290:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790772346.991306:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772346.991321:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff932894b73380) 00000020:00000080:0.0:1790772346.991340:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790772346.991346:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790772346.991403:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9328ba5e9800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790772346.991411:0:6720:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790772346.991417:0:6720:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd3c7635991be1305 00010000:00010000:2.0:1790772346.996780:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1790772347.000433:0:6720:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790772347.007740:0:6720:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790772347.008135:0:6720:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790772347.018857:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790772347.024032:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790772347.030846:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790772347.030861:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772347.030867:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772347.030870:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790772347.030909:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772347.030915:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772347.030917:0:6720:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772347.030920:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772347.030923:0:6720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790772347.033146:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772347.033158:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772347.033160:0:6720:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790772347.033166:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790772347.033326:0:6701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790772347.033356:0:6701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790772347.033376:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033388:0:6701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772347.033410:0:6701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328ba5e9800 from 1 10000000:01000000:3.0:1790772347.033413:0:6701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772347.033451:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033459:0:6701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033470:0:6701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772347.033493:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308800:0@lo:101: 00000100:00100000:3.0:1790772347.033560:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772347.033610:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772347.033637:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308800 00000100:00100000:3.0:1790772347.033643:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308800 00000100:00100000:3.0:1790772347.033682:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790772347.033691:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+11:6701:x1877760813308800:12345-0@lo:101: 00010000:00010000:3.0:1790772347.033705:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772347.033719:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be130c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033755:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be130c expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033766:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be130c expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033775:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328813fc800, rc 0) 00000100:00100000:3.0:1790772347.033815:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813308800:12345-0@lo:101: Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772347.033822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790772347.033867:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308800:0@lo:101: 00010000:00010000:3.0:1790772347.033910:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.033919:0:6701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772347.035438:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308928:0@lo:501: 00000100:00100000:3.0:1790772347.035495:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772347.036081:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772347.041417:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813308928 00000100:00100000:1.0:1790772347.041433:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813308928 00000100:00100000:1.0:1790772347.041497:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790772347.041507:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813308928:12345-0@lo:501: 00000100:00100000:1.0:1790772347.041816:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813308928:12345-0@lo:501: Request processed in 311us (6321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772347.041824:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772347.044446:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813308928:0@lo:501: 00000100:00100000:0.0:1790772347.044508:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309056:0@lo:503: 00000100:00100000:0.0:1790772347.044581:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772347.044696:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891b1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772347.049947:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309056 00000100:00100000:2.0:1790772347.049960:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309056 00000100:00100000:2.0:1790772347.050010:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772347.050020:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309056:12345-0@lo:503: 00000100:00100000:2.0:1790772347.050460:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309056:12345-0@lo:503: Request processed in 440us (5876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772347.050468:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790772347.050622:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309056:0@lo:503: 00000040:00080000:0.0:1790772347.051038:0:6701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772347.051110:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309184:0@lo:502: 00000100:00100000:0.0:1790772347.051155:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772347.051193:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9313300 going to sleep for 11 seconds 00000100:00100000:1.0:1790772347.051355:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309184 00000100:00100000:1.0:1790772347.051361:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309184 00000100:00100000:1.0:1790772347.051402:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790772347.051410:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309184:12345-0@lo:502: 00000100:00100000:1.0:1790772347.051585:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309184:12345-0@lo:502: Request processed in 175us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772347.051592:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790772347.051740:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309184:0@lo:502: 00000040:00080000:0.0:1790772347.052616:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790772347.052701:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790772347.052739:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309312:0@lo:502: 00000100:00100000:0.0:1790772347.052794:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772347.052935:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9313300 going to sleep for 11 seconds 00000100:00100000:1.0:1790772347.054099:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309312 00000100:00100000:1.0:1790772347.054112:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309312 00000100:00100000:1.0:1790772347.058086:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772347.058113:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309312:12345-0@lo:502: 00000100:00100000:1.0:1790772347.058393:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309312:12345-0@lo:502: Request processed in 294us (5599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772347.058401:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790772347.058545:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309312:0@lo:502: 00000040:00080000:0.0:1790772347.058699:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790772347.058719:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790772347.059385:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772347.059394:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772347.059402:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790772347.059409:0:6724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9328ba5e9800 00000020:00000080:0.0:1790772347.059411:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772347.059432:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772347.059435:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772347.059436:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790772347.059439:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790772347.059559:0:6701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790772347.059583:0:6701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772347.059605:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.059617:0:6701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772347.059668:0:6701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790772347.059671:0:6701:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9328ba5e9800 10000000:01000000:2.0:1790772347.059674:0:6701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9328ba5e9800 10000000:01000000:2.0:1790772347.059678:0:6701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772347.059683:0:6701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9328ba5e9800 from 1 10000000:01000000:2.0:1790772347.059686:0:6701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772347.059719:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.059728:0:6701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.059738:0:6701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772347.059759:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309440:0@lo:101: 00000100:00100000:2.0:1790772347.059810:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.066284:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf950180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772347.070484:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309440 00000100:00100000:3.0:1790772347.070502:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309440 00000100:00100000:3.0:1790772347.070564:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790772347.070574:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813309440:12345-0@lo:101: 00010000:00010000:3.0:1790772347.070592:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772347.070612:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be131a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.070641:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be131a expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.070652:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be131a expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.070661:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328813fd600, rc 0) 00000100:00100000:3.0:1790772347.070799:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309440:12345-0@lo:101: Request processed in 225us (10987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772347.070821:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772347.077746:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309440:0@lo:101: 00010000:00010000:2.0:1790772347.077779:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.077814:0:6701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772347.077980:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309568:0@lo:501: 00000100:00100000:2.0:1790772347.078040:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.078086:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf950180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772347.078206:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309568 00000100:00100000:1.0:1790772347.078214:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309568 00000100:00100000:1.0:1790772347.078253:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790772347.078262:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309568:12345-0@lo:501: 00000100:00100000:1.0:1790772347.078504:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309568:12345-0@lo:501: Request processed in 241us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772347.078512:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790772347.078718:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309568:0@lo:501: 00000100:00100000:2.0:1790772347.078747:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309696:0@lo:503: 00000100:00100000:2.0:1790772347.078783:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.078811:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf950180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772347.078828:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309696 00000100:00100000:2.0:1790772347.078831:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309696 00000100:00100000:2.0:1790772347.078850:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790772347.078856:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309696:12345-0@lo:503: 00000100:00100000:2.0:1790772347.079038:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309696:12345-0@lo:503: Request processed in 181us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772347.079045:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772347.079152:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309696:0@lo:503: 00000040:00080000:3.0:1790772347.079429:0:6701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790772347.079486:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309824:0@lo:502: 00000100:00100000:3.0:1790772347.079521:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772347.079543:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772347.079671:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309824 00000100:00100000:1.0:1790772347.079677:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309824 00000100:00100000:1.0:1790772347.079697:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790772347.079703:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309824:12345-0@lo:502: 00000100:00100000:1.0:1790772347.079864:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309824:12345-0@lo:502: Request processed in 160us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772347.079871:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790772347.080438:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309824:0@lo:502: 00000040:00080000:3.0:1790772347.080704:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790772347.080761:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790772347.080794:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790772347.080839:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790772347.080925:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790772347.080977:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790772347.081015:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790772347.081049:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790772347.081097:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790772347.081135:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790772347.081167:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790772347.081366:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790772347.081409:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790772347.081446:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790772347.081510:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790772347.081548:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790772347.081581:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790772347.081626:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790772347.081664:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790772347.081698:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790772347.081747:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790772347.081784:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790772347.081830:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1790772347.089867:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1790772347.090161:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1790772347.090215:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1790772347.090282:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1790772347.090316:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1790772347.090364:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309952:0@lo:502: 00000100:00100000:2.0:1790772347.090444:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.090486:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf950900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772347.090530:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813309952 00000100:00100000:1.0:1790772347.090548:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813309952 00000100:00100000:1.0:1790772347.091165:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790772347.091180:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309952:12345-0@lo:502: 00000100:00100000:3.0:1790772347.091991:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813309952:0@lo:502: 00000100:00100000:1.0:1790772347.092015:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813309952:12345-0@lo:502: Request processed in 765us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772347.092094:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:3.0:1790772347.092141:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790772347.092161:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1790772347.094663:0:6726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790772347.094685:0:6726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9328882f4d40) 00000020:00000080:2.0:1790772347.094708:0:6726:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1790772347.094791:0:6726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9328ba5e9800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790772347.094795:0:6726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9328ba5e9800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790772347.094798:0:6726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328ba5e9800 3 00010000:00080000:2.0:1790772347.094829:0:6726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9328bf9bc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1790772347.098105:0:6726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1790772347.099126:0:6726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790772347.099166:0:6726:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772347.099179:0:6726:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd3c7635991be132f 00000100:00080000:2.0:1790772347.099190:0:6726:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772347.099327:0:6726:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9328bf9bc800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1790772347.099365:0:6726:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328b8d68e00 x1877760813310080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772347.099390:0:6726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790772347.099622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1877760813310080:0@lo:38: 00000100:00100000:0.0:1790772347.099694:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.099830:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310080 00000100:00100000:2.0:1790772347.099837:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310080 00000100:00100000:2.0:1790772347.099895:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772347.099911:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1877760813310080:12345-0@lo:38: 00010000:00080000:2.0:1790772347.099937:0:5857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1790772347.099993:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd3c7635991be1336 00000004:00100000:2.0:1790772347.100008:0:5857:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790772347.100038:0:5857:0:(import.c:65:import_set_state_nolock()) ffff9328bf9b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772347.100090:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877760813310080:12345-0@lo:38: Request processed in 178us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772347.100098:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1790772347.100232:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1790772347.100394:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9328b8d68e00 x1877760813310080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772347.100405:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772347.100412:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790772347.100418:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790772347.100423:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790772347.100424:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9328bf9bc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790772347.100429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1877760813310080:0@lo:38: 00000020:01000000:2.0:1790772347.100990:0:6701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1790772347.101027:0:6701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772347.101046:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.101056:0:6701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790772347.101101:0:6701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790772347.101104:0:6701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790772347.101105:0:6701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772347.101108:0:6701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772347.101110:0:6701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772347.101112:0:6701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772347.101115:0:6701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772347.101117:0:6701:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790772347.101118:0:6701:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790772347.101121:0:6701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772347.101123:0:6701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772347.101128:0:6701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1790772347.101131:0:6701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772347.101133:0:6701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790772347.101134:0:6701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772347.101135:0:6701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772347.101136:0:6701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772347.101137:0:6701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772347.101138:0:6701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772347.101139:0:6701:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790772347.101140:0:6701:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790772347.101141:0:6701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772347.101142:0:6701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772347.101163:0:6701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790772347.101178:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813310208:0@lo:253: 00000100:00100000:2.0:1790772347.101725:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.101774:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf9500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772347.101792:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310208 00000100:00100000:0.0:1790772347.101809:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310208 00000100:00100000:0.0:1790772347.101908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790772347.101922:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6701:x1877760813310208:12345-0@lo:253: 20000000:01000000:0.0:1790772347.101973:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790772347.101991:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790772347.102027:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772347.102092:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813310336:0@lo:400: 00000100:00100000:2.0:1790772347.102131:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772347.102454:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310336 00000100:00100000:3.0:1790772347.102462:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310336 00000100:00100000:3.0:1790772347.102550:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772347.102561:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813310336:12345-0@lo:400: 00000100:00100000:3.0:1790772347.102635:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813310336:12345-0@lo:400: Request processed in 77us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772347.102643:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790772347.102743:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9328831c5c00 x1877760813310336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772347.102758:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813310336:0@lo:400: 20000000:01000000:0.0:1790772347.132214:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790772347.132238:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790772347.132492:0:5871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790772347.132498:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790772347.132529:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.132552:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1295 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.132563:0:5871:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.132629:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1295 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.132646:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1295 expref: 13 pid: 5850 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772347.132685:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1877760813310464:0@lo:104: 00000100:00100000:3.0:1790772347.132781:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772347.132869:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790772347.133208:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310464 00000100:00100000:2.0:1790772347.133220:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310464 00000100:00100000:2.0:1790772347.133289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772347.133300:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5871:x1877760813310464:12345-0@lo:104: 00010000:00010000:2.0:1790772347.133317:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.133392:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772347.133399:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5871:x1877760813310464:12345-0@lo:104: Request processed in 102us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772347.133407:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790772347.133435:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772347.133442:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.133450:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881681e00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772347.133454:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.133464:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772347.133472:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772347.133477:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772347.133515:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.133536:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772347.133558:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.133565:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be1295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be129c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.133585:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772347.133587:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772347.133589:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772347.133872:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813310592:0@lo:103: 00000100:00100000:2.0:1790772347.133965:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772347.134013:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310592 00000100:00100000:2.0:1790772347.134018:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310592 00010000:00010000:2.0:1790772347.134050:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1295 expref: 14 pid: 5850 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772347.134075:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772347.134082:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:3315:x1877760813310592:12345-0@lo:103: 00010000:00010000:2.0:1790772347.134095:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772347.134100:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1295 expref: 14 pid: 5850 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134111:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1295 expref: 14 pid: 5850 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134132:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134156:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772347.134172:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001674706s 00010000:00010000:2.0:1790772347.134177:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134186:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134194:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134201:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134207:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fd400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772347.134212:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134220:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134228:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772347.134251:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772347.134293:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:3315:x1877760813310592:12345-0@lo:103: Request processed in 211us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772347.134299:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790772347.134435:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881518a00/0xd3c7635991be129c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1295 expref: 13 pid: 5850 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772347.134448:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1877760813310464:0@lo:104: 00010000:00010000:3.0:1790772347.134469:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.134479:0:5871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.134486:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772347.134493:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fd400/0xd3c7635991be133d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772347.134709:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813310592:0@lo:103: 00000100:00100000:0.0:1790772347.147562:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:6701:x1877760813310208:12345-0@lo:253: Request processed in 45629us (45822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772347.147581:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790772347.149217:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:6701:1877760813310208:0@lo:253: 10000000:01000000:2.0:1790772347.149239:0:6701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790772347.149242:0:6701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772347.149244:0:6701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790772347.149246:0:6701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772347.149247:0:6701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772347.149248:0:6701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772347.149249:0:6701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772347.149251:0:6701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772347.149253:0:6701:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790772347.149254:0:6701:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790772347.149256:0:6701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772347.149257:0:6701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772347.149279:0:6701:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790772347.158695:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772347.158941:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772347.159127:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772347.159225:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790772347.159595:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790772347.160096:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790772347.175929:0:6701:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790772347.590429:0:6701:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790772347.590434:0:6701:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790772347.590463:0:6701:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790772347.590514:0:6701:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790772347.590539:0:6701:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790772347.590568:0:6701:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1790772347.659362:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772348.689440:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772349.720796:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772350.731035:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772351.755197:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772352.207108:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813310720:0@lo:400: 00000100:00100000:3.0:1790772352.207190:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772352.207254:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813310848:0@lo:400: 00000100:00100000:3.0:1790772352.207280:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772352.207301:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772352.207307:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813310976:0@lo:400: 00000100:00100000:3.0:1790772352.207340:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772352.207376:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310720 00000100:00100000:3.0:1790772352.207384:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310720 00000100:00100000:3.0:1790772352.207428:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790772352.207438:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3316:x1877760813310720:12345-0@lo:400: 00000100:00100000:3.0:1790772352.207490:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3316:x1877760813310720:12345-0@lo:400: Request processed in 54us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772352.207497:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790772352.207528:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310848 00000100:00100000:3.0:1790772352.207532:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310848 00000100:00100000:3.0:1790772352.207554:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813310976 00000100:00100000:3.0:1790772352.207557:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813310976 00000100:00100000:3.0:1790772352.207587:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772352.207593:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813310848:12345-0@lo:400: 00000100:00100000:3.0:1790772352.207633:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813310848:12345-0@lo:400: Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772352.207639:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772352.207650:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772352.207657:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813310976:12345-0@lo:400: 00000100:00100000:3.0:1790772352.207684:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813310976:12345-0@lo:400: Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772352.207689:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790772352.207729:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328831c5880 x1877760813310976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772352.207742:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813310976:0@lo:400: 00010000:00080000:3.0:1790772352.207753:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328831c5500 x1877760813310848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772352.207769:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813310848:0@lo:400: 00000100:00100000:3.0:1790772352.207796:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813310720:0@lo:400: 00000100:00080000:0.0:1790772352.207932:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1790772352.717632:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790772352.717641:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff932891b62000 from 21 10000000:01000000:2.0:1790772352.717647:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772352.717698:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.717711:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.717724:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772352.717749:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311104:0@lo:101: 00000100:00100000:2.0:1790772352.717850:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772352.717926:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1767f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.718024:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311104 00000100:00100000:1.0:1790772352.718032:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311104 00000100:00100000:1.0:1790772352.718089:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790772352.718099:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813311104:12345-0@lo:101: 00010000:00010000:1.0:1790772352.718122:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772352.718136:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1344 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.718163:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1344 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.718175:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1344 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.718185:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881680a00, rc 0) 00000100:00100000:1.0:1790772352.718227:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813311104:12345-0@lo:101: Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.718235:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790772352.718278:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311104:0@lo:101: 00010000:00010000:1.0:1790772352.718291:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.718300:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772352.718353:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311232:0@lo:501: 00000100:00100000:1.0:1790772352.718377:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.718399:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.718546:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311232 00000100:00100000:2.0:1790772352.718551:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311232 00000100:00100000:2.0:1790772352.718588:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772352.718595:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813311232:12345-0@lo:501: 00000100:00100000:2.0:1790772352.718863:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813311232:12345-0@lo:501: Request processed in 268us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.718870:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790772352.719001:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311232:0@lo:501: 00000100:00100000:1.0:1790772352.719030:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311360:0@lo:503: 00000100:00100000:1.0:1790772352.719065:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.719101:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.719357:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311360 00000100:00100000:2.0:1790772352.719362:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311360 00000100:00100000:2.0:1790772352.719393:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790772352.719401:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813311360:12345-0@lo:503: 00000100:00100000:2.0:1790772352.719538:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813311360:12345-0@lo:503: Request processed in 138us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.719546:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790772352.719633:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311360:0@lo:503: 00000100:00100000:1.0:1790772352.720089:0:6975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6975:1877760813311488:0@lo:502: 00000100:00100000:1.0:1790772352.720125:0:6975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.720155:0:6975:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.720208:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311488 00000100:00100000:2.0:1790772352.720213:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311488 00000100:00100000:2.0:1790772352.720242:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790772352.720248:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6975:x1877760813311488:12345-0@lo:502: 00000100:00100000:2.0:1790772352.720395:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6975:x1877760813311488:12345-0@lo:502: Request processed in 147us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.720404:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790772352.720486:0:6975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6975:1877760813311488:0@lo:502: 00000100:00100000:1.0:1790772352.720537:0:6975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6975:1877760813311616:0@lo:502: 00000100:00100000:1.0:1790772352.720566:0:6975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.720587:0:6975:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.720773:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311616 00000100:00100000:2.0:1790772352.720778:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311616 00000100:00100000:2.0:1790772352.720817:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772352.720825:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6975:x1877760813311616:12345-0@lo:502: 00000100:00100000:2.0:1790772352.720999:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:6975:x1877760813311616:12345-0@lo:502: Request processed in 175us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.721006:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790772352.721203:0:6975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6975:1877760813311616:0@lo:502: 00000040:00080000:1.0:1790772352.721221:0:6975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1790772352.721761:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1790772352.721781:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772352.721790:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.721810:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772352.721821:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772352.721824:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff932891b62000 from 4 10000000:01000000:2.0:1790772352.721826:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772352.721865:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.722098:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.722111:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772352.722127:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311744:0@lo:101: 00000100:00100000:2.0:1790772352.722164:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772352.722199:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.722247:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311744 00000100:00100000:1.0:1790772352.722252:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311744 00000100:00100000:1.0:1790772352.722286:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790772352.722294:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813311744:12345-0@lo:101: 00010000:00010000:1.0:1790772352.722305:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772352.722317:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1352 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722338:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1352 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722347:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1352 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722357:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881680c00, rc 0) 00000100:00100000:1.0:1790772352.722391:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813311744:12345-0@lo:101: Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.722407:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790772352.722441:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311744:0@lo:101: 00010000:00010000:1.0:1790772352.722453:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722462:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772352.722503:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311872:0@lo:256: 00000100:00100000:1.0:1790772352.722532:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.722546:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.722558:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813311872 00000100:00100000:1.0:1790772352.722561:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813311872 00000100:00100000:1.0:1790772352.722587:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790772352.722593:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813311872:12345-0@lo:256: 20000000:01000000:1.0:1790772352.722606:0:5848:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772352.722621:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772352.722624:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790772352.722696:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813311872:12345-0@lo:256: Request processed in 102us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.722703:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790772352.722730:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813311872:0@lo:256: 10000000:01000000:1.0:1790772352.722763:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772352.722769:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722778:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772352.722789:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790772352.722790:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1790772352.722793:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772352.722818:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722826:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722834:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772352.722855:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312000:0@lo:101: 00000100:00100000:1.0:1790772352.722916:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.722934:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.722944:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312000 00000100:00100000:1.0:1790772352.722947:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312000 00000100:00100000:1.0:1790772352.722965:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772352.722971:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813312000:12345-0@lo:101: 00010000:00010000:1.0:1790772352.722977:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772352.722984:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1360 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.722999:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1360 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.723007:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1360 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.723024:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881681200, rc 0) 00000100:00100000:1.0:1790772352.723050:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813312000:12345-0@lo:101: Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.723056:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772352.723084:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312000:0@lo:101: 00010000:00010000:1.0:1790772352.723094:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.723102:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772352.723140:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312128:0@lo:501: 00000100:00100000:1.0:1790772352.723162:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.723174:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.723183:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312128 00000100:00100000:1.0:1790772352.723186:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312128 00000100:00100000:1.0:1790772352.723204:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772352.723210:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813312128:12345-0@lo:501: 00000100:00100000:1.0:1790772352.723429:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813312128:12345-0@lo:501: Request processed in 218us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.723436:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772352.723462:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312128:0@lo:501: 00000100:00100000:1.0:1790772352.723486:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312256:0@lo:503: 00000100:00100000:1.0:1790772352.723519:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772352.723531:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.723545:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312256 00000100:00100000:1.0:1790772352.723548:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312256 00000100:00100000:1.0:1790772352.723566:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772352.723572:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813312256:12345-0@lo:503: 00000100:00100000:1.0:1790772352.723771:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813312256:12345-0@lo:503: Request processed in 198us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.723779:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772352.723826:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312256:0@lo:503: 00000100:00100000:3.0:1790772352.726030:0:6976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6976:1877760813312384:0@lo:502: 00000100:00100000:3.0:1790772352.726103:0:6976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772352.726156:0:6976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.726705:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312384 00000100:00100000:2.0:1790772352.726713:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312384 00000100:00100000:2.0:1790772352.726761:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790772352.726769:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:6976:x1877760813312384:12345-0@lo:502: 00000100:00100000:2.0:1790772352.727530:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:6976:x1877760813312384:12345-0@lo:502: Request processed in 759us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.727542:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790772352.734724:0:6976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6976:1877760813312384:0@lo:502: 00000020:01000000:3.0:1790772352.734786:0:6976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790772352.734793:0:6976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790772352.734812:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772352.734815:0:6976:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790772352.734820:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790772352.734825:0:6976:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1790772352.734858:0:6976:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790772352.734861:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790772352.735002:0:6976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9328b9bf19c0) 00000020:00000080:3.0:1790772352.735026:0:6976:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1790772352.735035:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790772352.735117:0:6976:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790772352.735123:0:6976:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790772352.735130:0:6976:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be1375 00010000:00080000:3.0:1790772352.735159:0:6976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932783098800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1790772352.735392:0:6976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1790772352.784907:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790772352.813941:0:6976:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790772352.813970:0:6976:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790772352.814526:0:6976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772352.814826:0:6976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772352.814893:0:6976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790772352.814956:0:6976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790772352.819164:0:6988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772352.819172:0:6988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790772352.819999:0:6976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790772352.820012:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790772352.820046:0:6976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790772352.820069:0:6976:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be137c 00000100:00080000:3.0:1790772352.820080:0:6976:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772352.820105:0:6976:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff932783098800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1790772352.820145:0:6976:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328831c5c00 x1877760813312512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772352.820163:0:6976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790772352.820263:0:6976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772352.820268:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772352.820270:0:6976:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790772352.820273:0:6976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772352.820277:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772352.820279:0:6976:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772352.820282:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772352.820284:0:6976:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790772352.820312:0:6976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6976:1877760813312640:0@lo:502: 00000100:00100000:3.0:1790772352.820403:0:6976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772352.821170:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813312512:0@lo:8: 00000100:00100000:0.0:1790772352.821213:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772352.821529:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312512 00000100:00100000:0.0:1790772352.821538:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312512 00000100:00100000:0.0:1790772352.821571:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772352.821579:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1877760813312512:12345-0@lo:8: 00010000:00080000:0.0:1790772352.821619:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1790772352.821645:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be1383 00002000:00100000:0.0:1790772352.821683:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9328bf6ce800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790772352.821689:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1790772352.821692:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790772352.821825:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790772352.821994:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790772352.822018:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9328bf6cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772352.822080:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1877760813312512:12345-0@lo:8: Request processed in 499us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772352.822088:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790772352.822131:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328831c5c00 x1877760813312512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772352.822159:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772352.822167:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790772352.822175:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790772352.822180:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790772352.822183:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932783098800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790772352.822194:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790772352.822199:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813312512:0@lo:8: 00000004:00080000:1.0:1790772352.822652:0:6988:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790772352.822756:0:6988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173642879856ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790772352.822979:0:6976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.823569:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312640 00000100:00100000:2.0:1790772352.823578:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312640 00000100:00100000:2.0:1790772352.823628:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790772352.823639:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:6976:x1877760813312640:12345-0@lo:502: 00000100:00100000:2.0:1790772352.824054:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:6976:x1877760813312640:12345-0@lo:502: Request processed in 416us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.824063:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790772352.826134:0:6976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:6976:1877760813312640:0@lo:502: 00000020:01000000:2.0:1790772352.826174:0:6976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772352.826181:0:6976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772352.826183:0:6976:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790772352.826188:0:6976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1790772352.826320:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1790772352.826338:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790772352.826348:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.826360:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772352.826384:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790772352.826386:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff932894b719c0 from 1 10000000:01000000:2.0:1790772352.826389:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790772352.826422:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.826431:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.826441:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772352.826460:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312768:0@lo:101: 00000100:00100000:2.0:1790772352.826516:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772352.826556:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288391e300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772352.826575:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312768 00000100:00100000:2.0:1790772352.826582:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312768 00000100:00100000:2.0:1790772352.827568:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790772352.827581:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813312768:12345-0@lo:101: 00010000:00010000:2.0:1790772352.827604:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772352.827620:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be138a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.827645:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be138a expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.827656:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be138a expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772352.827678:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519e00, rc 0) 00000100:00100000:2.0:1790772352.827733:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813312768:12345-0@lo:101: Request processed in 155us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772352.827741:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790772352.831332:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312768:0@lo:101: 00010000:00010000:0.0:1790772352.831362:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772352.831375:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772352.831453:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888280e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312896:0@lo:501: 00000100:00100000:0.0:1790772352.831510:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772352.832102:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a06d2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772352.838972:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813312896 00000100:00100000:3.0:1790772352.838984:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813312896 00000100:00100000:3.0:1790772352.839036:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790772352.839045:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813312896:12345-0@lo:501: 00000100:00100000:3.0:1790772352.839329:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813312896:12345-0@lo:501: Request processed in 283us (7818us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772352.839337:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772352.841038:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888280e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813312896:0@lo:501: 10000000:01000000:1.0:1790772352.841092:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790772352.841104:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772352.841116:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772352.969834:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790772352.970340:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813313024:0@lo:13: 00000100:00100000:3.0:1790772352.970418:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790772352.970535:0:6990:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790772352.970559:0:6990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313152:0@lo:7: 00000100:00100000:0.0:1790772352.970589:0:6990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772352.970607:0:6990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a06d2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772352.973072:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313024 00000100:00100000:1.0:1790772352.973089:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313024 00000100:00100000:1.0:1790772352.973169:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772352.973179:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813313024:12345-0@lo:13: 00002000:00000024:1.0:1790772352.973219:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:2.0:1790772352.973307:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772352.976008:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313152 00000100:00100000:3.0:1790772352.976023:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313152 00000100:00100000:3.0:1790772352.976077:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772352.976088:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6990:x1877760813313152:12345-0@lo:7: 00000100:00100000:1.0:1790772352.977026:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877760813313024:12345-0@lo:13: Request processed in 3843us (6603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772352.977046:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790772352.977221:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888280700 x1877760813313024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772352.977242:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813313024:0@lo:13: 00002000:00080000:3.0:1790772353.003373:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790772353.003381:0:6706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790772353.003481:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6990:x1877760813313152:12345-0@lo:7: Request processed in 27391us (32886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772353.003492:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790772353.004752:0:6990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888282300 x1877760813313152/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790772368 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772353.004770:0:6990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313152:0@lo:7: 00000004:00080000:0.0:1790772353.004786:0:6990:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790772353.005555:0:6990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313280:0@lo:5: 00000100:00100000:0.0:1790772353.005669:0:6990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772353.005722:0:6990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a06d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772353.005749:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313280 00000100:00100000:0.0:1790772353.005756:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313280 00000100:00100000:0.0:1790772353.005807:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772353.005817:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6990:x1877760813313280:12345-0@lo:5: 00002000:00080000:0.0:1790772353.006012:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790772353.006018:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790772353.013264:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6990:x1877760813313280:12345-0@lo:5: Request processed in 7441us (7587us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790772353.013277:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790772353.013334:0:6990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888282300 x1877760813313280/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772369 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772353.013352:0:6990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313280:0@lo:5: 00000004:00080000:0.0:1790772353.013367:0:6990:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790772353.013405:0:6990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313408:0@lo:700: 00000100:00100000:0.0:1790772353.013438:0:6990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772353.013470:0:6990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a06d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772353.013494:0:6712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313408 00000100:00100000:0.0:1790772353.013500:0:6712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313408 00000100:00100000:0.0:1790772353.013543:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772353.013550:0:6712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6990:x1877760813313408:12345-0@lo:700: 00000100:00100000:0.0:1790772353.013582:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6712:1877760813313536:0@lo:700: 00000100:00100000:0.0:1790772353.015039:0:6712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772353.015070:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a06d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772353.015114:0:5862:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313536 00000100:00100000:0.0:1790772353.015121:0:5862:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313536 00000100:00100000:0.0:1790772353.015157:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772353.015165:0:5862:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6712:x1877760813313536:12345-0@lo:700: 40000000:02000000:0.0:1790772353.090452:0:5862:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1790772353.101396:0:5862:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6712:x1877760813313536:12345-0@lo:700: Request processed in 86224us (86355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772353.101411:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790772353.109944:0:6712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888283100 x1877760813313536/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790772369 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772353.109965:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6712:1877760813313536:0@lo:700: 40000000:02000000:2.0:1790772353.109980:0:6712:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1790772353.267005:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1790772353.267022:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790772353.267171:0:6712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6990:x1877760813313408:12345-0@lo:700: Request processed in 253617us (253728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772353.267192:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790772353.267217:0:6990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888281180 x1877760813313408/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790772369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772353.267229:0:6990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790772353.267244:0:6990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313408:0@lo:700: 00000004:02000040:1.0:1790772353.363394:0:6990:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1790772353.376816:0:6990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313664:0@lo:5: 00000100:00100000:1.0:1790772353.376923:0:6990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772353.376981:0:6990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ae588c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772353.377496:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313664 00000100:00100000:3.0:1790772353.377507:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313664 00000100:00100000:3.0:1790772353.377562:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772353.377572:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6990:x1877760813313664:12345-0@lo:5: 00002000:00080000:3.0:1790772353.396239:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790772353.396265:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1790772353.410798:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6990:x1877760813313664:12345-0@lo:5: Request processed in 33209us (33857us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790772353.410812:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790772353.423025:0:6990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328ba717800 x1877760813313664/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772353.423045:0:6990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6990:1877760813313664:0@lo:5: 00000004:00080000:1.0:1790772353.423072:0:6990:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1790772353.803563:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772354.255484:0:7074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790772354.832358:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772355.853311:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772356.876916:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772357.835138:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813313920:0@lo:400: 00000100:00100000:2.0:1790772357.835214:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772357.835269:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772357.835276:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813314048:0@lo:400: 00000100:00100000:2.0:1790772357.835310:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772357.835352:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313920 00000100:00100000:2.0:1790772357.835359:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313920 00000100:00100000:2.0:1790772357.835399:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314048 00000100:00100000:2.0:1790772357.835403:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314048 00000100:00100000:2.0:1790772357.835429:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772357.835438:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813313920:12345-0@lo:400: 00000100:00100000:2.0:1790772357.835501:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813313920:12345-0@lo:400: Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772357.835509:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772357.835528:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772357.835534:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813314048:12345-0@lo:400: 00000100:00100000:2.0:1790772357.835561:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813314048:12345-0@lo:400: Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772357.835566:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790772357.835587:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790772357.835614:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d69180 x1877760813314048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772357.835627:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813314048:0@lo:400: 00010000:00080000:2.0:1790772357.835638:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d6bb80 x1877760813313920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772357.835647:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813313920:0@lo:400: 00000100:00100000:3.0:1790772357.835654:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813313792:0@lo:400: 00000100:00100000:3.0:1790772357.835701:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772357.835747:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772357.835753:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813314176:0@lo:400: 00000100:00100000:3.0:1790772357.835778:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772357.835807:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314176 00000100:00100000:3.0:1790772357.835810:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314176 00000100:00100000:3.0:1790772357.835842:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772357.835848:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1877760813314176:12345-0@lo:400: 00000100:00100000:2.0:1790772357.836010:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813313792 00000100:00100000:2.0:1790772357.836015:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813313792 00000100:00100000:2.0:1790772357.836054:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772357.836061:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3316:x1877760813313792:12345-0@lo:400: 00000100:00080000:1.0:1790772357.841960:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772357.842018:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d69c00 x1877760813314176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772357.842036:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813314176:0@lo:400: 00000100:00100000:2.0:1790772357.843371:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3316:x1877760813313792:12345-0@lo:400: Request processed in 6972us (7330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772357.843386:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790772357.843508:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1877760813314176:12345-0@lo:400: Request processed in 7657us (7726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772357.843518:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772357.843915:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813313792:0@lo:400: 00010000:00010000:0.0:1790772357.900363:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772358.370759:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813314304:0@lo:13: 00000100:00100000:1.0:1790772358.370836:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772358.377844:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314304 00000100:00100000:2.0:1790772358.377858:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314304 00000100:00100000:2.0:1790772358.377934:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772358.377944:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1877760813314304:12345-0@lo:13: 00002000:00000024:2.0:1790772358.377988:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772358.378080:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1877760813314304:12345-0@lo:13: Request processed in 137us (7243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772358.378088:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790772358.384744:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d6bb80 x1877760813314304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772358.384780:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813314304:0@lo:13: 00000001:00080000:1.0:1790772358.510612:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790772358.928806:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772359.956393:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772360.972602:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772361.996998:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772362.955255:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813314688:0@lo:400: 00000100:00100000:3.0:1790772362.955316:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772362.955373:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772362.955378:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813314816:0@lo:400: 00000100:00100000:3.0:1790772362.955399:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772362.955430:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314688 00000100:00100000:3.0:1790772362.955437:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314688 00000100:00100000:3.0:1790772362.955482:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772362.955489:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813314688:12345-0@lo:400: 00000100:00100000:3.0:1790772362.955533:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813314688:12345-0@lo:400: Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772362.955540:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772362.955559:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314816 00000100:00100000:3.0:1790772362.955561:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314816 00000100:00100000:3.0:1790772362.955581:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772362.955586:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813314816:12345-0@lo:400: 00000100:00100000:3.0:1790772362.955610:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813314816:12345-0@lo:400: Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772362.955615:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790772362.955640:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772362.955645:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790772362.955674:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328831c5c00 x1877760813314816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772362.955695:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790772362.955708:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813314816:0@lo:400: 00010000:00080000:3.0:1790772362.955716:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328831c5500 x1877760813314688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772362.955722:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813314688:0@lo:400: 00000100:00100000:0.0:1790772362.955780:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813314560:0@lo:400: 00000100:00100000:0.0:1790772362.955807:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772362.955830:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772362.955834:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813314432:0@lo:400: 00000100:00100000:0.0:1790772362.955854:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772362.955942:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314432 00000100:00100000:2.0:1790772362.955945:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314432 00000100:00100000:2.0:1790772362.955965:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772362.955969:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3318:x1877760813314432:12345-0@lo:400: 00000100:00100000:2.0:1790772362.955997:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3318:x1877760813314432:12345-0@lo:400: Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772362.956001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772362.956026:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813314432:0@lo:400: 00000100:00100000:3.0:1790772362.960092:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314560 00000100:00100000:3.0:1790772362.960108:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314560 00000100:00100000:3.0:1790772362.960162:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772362.960172:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813314560:12345-0@lo:400: 00000100:00100000:3.0:1790772362.960271:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813314560:12345-0@lo:400: Request processed in 100us (4462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772362.960279:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790772362.960326:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328831c4e00 x1877760813314560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772362.960341:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813314560:0@lo:400: 00010000:00010000:1.0:1790772363.021445:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772363.469756:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813314944:0@lo:13: 00000100:00100000:2.0:1790772363.469831:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772363.477171:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813314944 00000100:00100000:1.0:1790772363.477187:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813314944 00000100:00100000:1.0:1790772363.477331:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772363.477343:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813314944:12345-0@lo:13: 00002000:00000024:1.0:1790772363.477390:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772363.477484:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813314944:12345-0@lo:13: Request processed in 143us (7652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772363.477491:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790772363.478119:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d69180 x1877760813314944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772363.478144:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813314944:0@lo:13: 00010000:00010000:3.0:1790772364.044060:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772365.067473:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790772366.082969:0:7643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790772366.082973:0:7643:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790772366.083115:0:7643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9328bb7d8800 00000020:01000004:3.0:1790772366.083133:0:7643:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790772366.083147:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790772366.083160:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9328b9bf3380) 00000020:00000080:3.0:1790772366.083175:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1790772366.091027:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790772366.110054:0:7643:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790772366.110327:0:7643:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790772366.147286:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790772366.156316:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790772366.156351:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790772366.156408:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790772366.156447:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790772366.157187:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790772366.157199:0:7643:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772366.157216:0:7643:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd3c7635991be139f 00000020:01000004:2.0:1790772366.157224:0:7643:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790772366.157247:0:7643:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790772366.157251:0:7643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790772366.157257:0:7643:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790772366.157279:0:7643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790772366.157284:0:7643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790772366.190556:0:7643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790772366.190605:0:7643:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790772366.190610:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790772366.190622:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790772366.190624:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772366.190625:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772366.190626:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772366.190628:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772366.190629:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772366.190631:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772366.190632:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772366.190634:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772366.190636:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790772366.190644:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790772366.190647:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772366.190648:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790772366.190649:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772366.190650:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772366.190650:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772366.190652:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772366.190653:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772366.190654:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772366.190655:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772366.190656:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772366.190657:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790772366.190693:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790772366.190711:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813315072:0@lo:253: 00000100:00100000:0.0:1790772366.190784:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.190842:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772366.192328:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315072 00000100:00100000:2.0:1790772366.192340:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315072 00000100:00100000:2.0:1790772366.192403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772366.192413:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:7643:x1877760813315072:12345-0@lo:253: 20000000:01000000:2.0:1790772366.192444:0:5849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790772366.192448:0:5849:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1790772366.192453:0:5849:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1790772366.192456:0:5849:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1790772366.193486:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772366.193713:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1790772366.193727:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1790772366.193765:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1790772366.193773:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1790772366.193800:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1790772366.193859:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1790772366.194243:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1790772366.194262:0:5849:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:2.0:1790772366.194264:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:2.0:1790772366.194296:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1790772366.194303:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790772366.194345:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1790772366.194353:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:2.0:1790772366.194381:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1790772366.194389:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790772366.194435:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1790772366.194482:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1790772366.195237:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1790772366.195256:0:5849:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:2.0:1790772366.195258:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:2.0:1790772366.195292:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1790772366.195298:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790772366.195325:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1790772366.195332:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:2.0:1790772366.195359:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1790772366.195367:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790772366.195406:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1790772366.195441:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1790772366.195455:0:5849:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1790772366.195458:0:5849:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1790772366.195464:0:5849:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790772366.195466:0:5849:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790772366.195469:0:5849:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790772366.195480:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790772366.195482:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790772366.195511:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790772366.195514:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790772366.198185:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1790772366.198267:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1790772366.198334:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790772366.198700:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1790772366.198756:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1790772366.198789:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1790772366.198802:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790772366.198805:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790772366.205163:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790772366.205272:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790772366.205307:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790772366.208590:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790772366.208777:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790772366.208846:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1790772366.208866:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790772366.208870:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790772366.214523:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1790772366.214868:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790772366.215233:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790772366.215331:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790772366.215347:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790772366.215350:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790772366.217445:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1790772366.217532:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1790772366.217599:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790772366.217961:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790772366.218005:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790772366.218088:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1790772366.218108:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790772366.218128:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218146:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218152:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be131a expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218159:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1344 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218165:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1360 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218171:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be138a expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218179:0:5849:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218220:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be138a expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218245:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be138a expref: 16 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.218262:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315200:0@lo:104: 00000100:00100000:3.0:1790772366.218332:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772366.218390:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1360 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218398:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1360 expref: 16 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.218406:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315328:0@lo:104: 00010000:00010000:3.0:1790772366.218430:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1344 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218437:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1344 expref: 16 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.218445:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315456:0@lo:104: 00010000:00010000:3.0:1790772366.218466:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be131a expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218474:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be131a expref: 16 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.218481:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315584:0@lo:104: 00010000:00010000:3.0:1790772366.218502:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.218520:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 16 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.218529:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315712:0@lo:104: 00000100:00100000:3.0:1790772366.218548:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772366.218652:0:5838:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790772366.218672:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.218687:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.218695:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.218703:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.218718:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315200 00000100:00100000:1.0:1790772366.218725:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315200 00000100:00100000:1.0:1790772366.218757:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315328 00000100:00100000:1.0:1790772366.218760:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315328 00000100:00100000:1.0:1790772366.218770:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315456 00000100:00100000:1.0:1790772366.218772:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315456 00000100:00100000:1.0:1790772366.218780:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315584 00000100:00100000:1.0:1790772366.218782:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315584 00000100:00100000:1.0:1790772366.218791:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315712 00000100:00100000:1.0:1790772366.218793:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315712 00000100:00100000:1.0:1790772366.218816:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772366.218823:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328883d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+7:5849:x1877760813315200:12345-0@lo:104: 00010000:00010000:1.0:1790772366.218836:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.218920:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772366.218927:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328883d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+7:5849:x1877760813315200:12345-0@lo:104: Request processed in 104us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.218935:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772366.219031:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772366.219038:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+6:5849:x1877760813315328:12345-0@lo:104: 00010000:00010000:1.0:1790772366.219046:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219080:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790772366.219085:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+6:5849:x1877760813315328:12345-0@lo:104: Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.219091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772366.219104:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772366.219110:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5849:x1877760813315456:12345-0@lo:104: 00010000:00010000:1.0:1790772366.219118:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219143:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790772366.219148:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:5849:x1877760813315456:12345-0@lo:104: Request processed in 39us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.219153:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772366.219164:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772366.219178:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+4:5849:x1877760813315584:12345-0@lo:104: 00010000:00010000:1.0:1790772366.219186:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219214:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790772366.219218:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+4:5849:x1877760813315584:12345-0@lo:104: Request processed in 43us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.219224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772366.219236:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772366.219242:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5849:x1877760813315712:12345-0@lo:104: 00010000:00010000:1.0:1790772366.219248:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219271:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790772366.219275:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5849:x1877760813315712:12345-0@lo:104: Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.219280:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790772366.219297:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790772366.219302:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219309:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772366.219313:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219321:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772366.219329:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772366.219342:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772366.219372:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219379:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772366.219397:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219403:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881518800/0xd3c7635991be138a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1391 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219417:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790772366.219420:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219426:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881680800 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772366.219428:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219435:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772366.219441:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772366.219448:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772366.219458:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219464:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772366.219480:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219486:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881680800/0xd3c7635991be1360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1367 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219500:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790772366.219503:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219508:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519600 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772366.219510:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219518:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772366.219524:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772366.219531:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772366.219542:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219547:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772366.219552:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219558:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881519600/0xd3c7635991be1344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be134b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219579:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772366.219587:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219593:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518c00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772366.219596:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219603:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772366.219609:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772366.219614:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772366.219627:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219633:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772366.219638:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219644:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be131a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1321 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219653:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772366.219656:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219661:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fc400 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772366.219664:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219693:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772366.219699:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772366.219703:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772366.219716:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219723:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772366.219727:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219733:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fc400/0xd3c7635991be12f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be12f7 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.219746:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772366.219748:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772366.219749:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772366.219756:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772366.219774:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813316224:0@lo:103: 00000100:00100000:1.0:1790772366.219807:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.219832:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790772366.219838:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813315840:0@lo:103: 00000100:00100000:1.0:1790772366.219857:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.219897:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813316352:0@lo:103: 00000100:00100000:1.0:1790772366.219919:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.219953:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316224 00000100:00100000:1.0:1790772366.219960:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316224 00010000:00010000:1.0:1790772366.219980:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be131a expref: 17 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772366.219995:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315840 00000100:00100000:1.0:1790772366.219998:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315840 00010000:00010000:1.0:1790772366.220008:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be138a expref: 18 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772366.220017:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316352 00000100:00100000:1.0:1790772366.220019:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316352 00010000:00010000:1.0:1790772366.220028:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 19 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772366.220038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772366.220044:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813316224:12345-0@lo:103: 00010000:00010000:1.0:1790772366.220054:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772366.220059:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be131a expref: 19 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.220067:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be131a expref: 19 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.220082:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772366.220111:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813316224:12345-0@lo:103: Request processed in 66us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.220117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772366.220131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772366.220138:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3317:x1877760813315840:12345-0@lo:103: 00010000:00010000:1.0:1790772366.220144:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772366.220156:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be138a expref: 18 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.220165:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be138a expref: 18 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.220173:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772366.220195:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3317:x1877760813315840:12345-0@lo:103: Request processed in 58us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.220201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772366.220213:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772366.220219:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3317:x1877760813316352:12345-0@lo:103: 00010000:00010000:1.0:1790772366.220225:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772366.220230:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 17 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.220237:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 17 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.220245:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772366.220265:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3317:x1877760813316352:12345-0@lo:103: Request processed in 46us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.220270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772366.220305:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813315840:0@lo:103: 00000100:00100000:1.0:1790772366.220314:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813316352:0@lo:103: 00000100:00100000:1.0:1790772366.220321:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813316224:0@lo:103: 00000100:00100000:3.0:1790772366.223947:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813315968:0@lo:103: 00000100:00100000:3.0:1790772366.224024:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.224086:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772366.224093:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813316096:0@lo:103: 00000100:00100000:3.0:1790772366.224115:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.224155:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813315968 00000100:00100000:3.0:1790772366.224163:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813315968 00010000:00010000:3.0:1790772366.224202:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1360 expref: 17 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224223:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316096 00000100:00100000:3.0:1790772366.224226:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316096 00010000:00010000:3.0:1790772366.224237:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1344 expref: 18 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772366.224257:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3315:x1877760813315968:12345-0@lo:103: 00010000:00010000:3.0:1790772366.224269:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772366.224274:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1360 expref: 18 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224285:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1360 expref: 18 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224318:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772366.224356:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3315:x1877760813315968:12345-0@lo:103: Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.224363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772366.224382:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772366.224388:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3315:x1877760813316096:12345-0@lo:103: 00010000:00010000:3.0:1790772366.224396:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772366.224400:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1344 expref: 17 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224408:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1344 expref: 17 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224420:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224428:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224443:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224450:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224456:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224463:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224474:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fda00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772366.224479:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224487:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224496:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224506:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772366.224532:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3315:x1877760813316096:12345-0@lo:103: Request processed in 144us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.224538:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772366.224585:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813316096:0@lo:103: 00000100:00100000:3.0:1790772366.224595:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813315968:0@lo:103: 00010000:00010000:3.0:1790772366.224759:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881519e00/0xd3c7635991be1391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be138a expref: 16 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224773:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315200:0@lo:104: 00010000:00010000:3.0:1790772366.224784:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881681200/0xd3c7635991be1367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1360 expref: 15 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224798:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315328:0@lo:104: 00010000:00010000:3.0:1790772366.224807:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881680a00/0xd3c7635991be134b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1344 expref: 14 pid: 5848 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224830:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315456:0@lo:104: 00010000:00010000:3.0:1790772366.224842:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fd600/0xd3c7635991be1321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be131a expref: 13 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224851:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315584:0@lo:104: 00010000:00010000:3.0:1790772366.224859:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881518200/0xd3c7635991be12f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be12f0 expref: 12 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.224868:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5849:1877760813315712:0@lo:104: 00010000:00010000:3.0:1790772366.224919:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224929:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224936:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.224942:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fda00/0xd3c7635991be13a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790772366.224955:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790772366.286724:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:7643:x1877760813315072:12345-0@lo:253: Request processed in 94303us (95930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772366.286739:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772366.286940:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813315072:0@lo:253: 10000000:01000000:3.0:1790772366.286956:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790772366.286959:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772366.286961:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790772366.286962:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772366.286963:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790772366.286982:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772366.286984:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772366.286986:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772366.286987:0:7643:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790772366.286989:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772366.286991:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772366.287011:0:7643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9328bb7d8800 from lustre-OST0001 10000000:01000000:3.0:1790772366.287040:0:7643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790772366.287043:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790772366.287052:0:7643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff932894b719c0 local copy 10000000:01000000:3.0:1790772366.287056:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790772366.287097:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.287108:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.287117:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.287135:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316480:0@lo:101: 00000100:00100000:3.0:1790772366.287172:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.287213:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772366.287819:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316480 00000100:00100000:0.0:1790772366.287828:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316480 00000100:00100000:0.0:1790772366.287922:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790772366.287932:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:7643:x1877760813316480:12345-0@lo:101: 00010000:00010000:0.0:1790772366.287947:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772366.287972:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030600/0xd3c7635991be13b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be13ad expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.287995:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030600/0xd3c7635991be13b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be13ad expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.288006:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030600/0xd3c7635991be13b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13ad expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.288014:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030600, rc 0) 00000100:00100000:0.0:1790772366.288064:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813316480:12345-0@lo:101: Request processed in 133us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772366.288071:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772366.288338:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316480:0@lo:101: 00010000:00010000:1.0:1790772366.288365:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.288375:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772366.288485:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316608:0@lo:501: 00000100:00100000:1.0:1790772366.288519:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.288555:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfaec540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772366.289064:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316608 00000100:00100000:0.0:1790772366.289071:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316608 00000100:00100000:0.0:1790772366.289159:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790772366.289168:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813316608:12345-0@lo:501: 00000100:00100000:0.0:1790772366.289431:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813316608:12345-0@lo:501: Request processed in 264us (911us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772366.289440:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790772366.289528:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316608:0@lo:501: 10000000:01000000:3.0:1790772366.289545:0:7643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790772366.289590:0:7643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790772366.289598:0:7643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.289607:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.289634:0:7643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.289665:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790772366.289700:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9328bb7d8800 10000000:01000000:3.0:1790772366.289705:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772366.289710:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790772366.289713:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772366.289717:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790772366.289719:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790772366.289742:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.289750:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.289760:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.289776:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316736:0@lo:101: 00000100:00100000:3.0:1790772366.289806:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772366.289860:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772366.289868:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.289914:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fda00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772366.289918:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.289926:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772366.289933:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772366.289938:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772366.289958:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.289965:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772366.289987:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.289994:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fda00/0xd3c7635991be13ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd3c7635991be13b4 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.290007:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772366.290009:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772366.290010:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772366.290023:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813316864:0@lo:103: 00000100:00100000:2.0:1790772366.290054:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772366.290103:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316864 00000100:00100000:2.0:1790772366.290108:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316864 00000100:00100000:2.0:1790772366.290141:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772366.290155:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:3315:x1877760813316864:12345-0@lo:103: 00010000:00010000:2.0:1790772366.290166:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772366.290180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030600/0xd3c7635991be13b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be13ad expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.290196:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772366.290225:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+11:3315:x1877760813316864:12345-0@lo:103: Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772366.290232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772366.290262:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813316864:0@lo:103: 00000100:00100000:3.0:1790772366.295676:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772366.303804:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316736 00000100:00100000:1.0:1790772366.303822:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316736 00000100:00100000:1.0:1790772366.303909:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790772366.303922:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+11:7643:x1877760813316736:12345-0@lo:101: 00010000:00010000:1.0:1790772366.303940:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772366.303961:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be13bb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.303989:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be13bb expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.304001:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13bb expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.304010:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881680800, rc 0) 00000100:00100000:1.0:1790772366.304089:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813316736:12345-0@lo:101: Request processed in 170us (14282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.304096:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790772366.304314:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316736:0@lo:101: 00010000:00010000:3.0:1790772366.304335:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.304344:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.304478:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316992:0@lo:501: 00000100:00100000:3.0:1790772366.304516:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.304544:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772366.304627:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813316992 00000100:00100000:2.0:1790772366.304633:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813316992 00000100:00100000:2.0:1790772366.304687:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772366.304696:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813316992:12345-0@lo:501: 00000100:00100000:2.0:1790772366.304943:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813316992:12345-0@lo:501: Request processed in 248us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772366.304951:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790772366.306594:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813316992:0@lo:501: 00000100:00100000:3.0:1790772366.306656:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317120:0@lo:503: 00000100:00100000:3.0:1790772366.306740:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.306784:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772366.306808:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317120 00000100:00100000:3.0:1790772366.306814:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317120 00000100:00100000:3.0:1790772366.306861:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772366.306869:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317120:12345-0@lo:503: 00000100:00100000:3.0:1790772366.307257:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317120:12345-0@lo:503: Request processed in 387us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.307265:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790772366.307412:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317120:0@lo:503: 00000040:00080000:0.0:1790772366.307739:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772366.307809:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317248:0@lo:502: 00000100:00100000:0.0:1790772366.307857:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.307922:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772366.308044:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317248 00000100:00100000:1.0:1790772366.308050:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317248 00000100:00100000:1.0:1790772366.308095:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772366.308103:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317248:12345-0@lo:502: 00000100:00100000:1.0:1790772366.308280:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317248:12345-0@lo:502: Request processed in 177us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.308287:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790772366.308376:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317248:0@lo:502: 00000040:00080000:0.0:1790772366.308631:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790772366.308691:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790772366.308730:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790772366.308771:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790772366.308801:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790772366.308826:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790772366.308847:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317376:0@lo:502: 00000100:00100000:0.0:1790772366.308902:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.308929:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772366.308946:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317376 00000100:00100000:2.0:1790772366.308951:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317376 00000100:00100000:2.0:1790772366.308985:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790772366.308992:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317376:12345-0@lo:502: 00000100:00100000:2.0:1790772366.309136:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317376:12345-0@lo:502: Request processed in 145us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772366.309144:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790772366.309168:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317376:0@lo:502: 00000040:00080000:0.0:1790772366.309243:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790772366.309255:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790772366.309972:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790772366.309981:0:7649:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790772366.309989:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772366.309991:0:7649:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790772366.309996:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772366.310011:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff932894b74d40) 00000020:00000080:0.0:1790772366.310034:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790772366.310039:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790772366.310103:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9328bb7d8800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790772366.310111:0:7649:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790772366.310116:0:7649:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd3c7635991be13d0 00010000:00010000:1.0:1790772366.313666:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790772366.314238:0:7649:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790772366.320349:0:7649:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790772366.326224:0:7649:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790772366.339508:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790772366.340271:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790772366.349857:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790772366.349869:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772366.349901:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772366.349903:0:7649:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790772366.349908:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772366.349912:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772366.349913:0:7649:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772366.349916:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772366.349918:0:7649:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790772366.349976:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772366.349985:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772366.349987:0:7649:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790772366.349991:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790772366.350181:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790772366.350205:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790772366.350224:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.350237:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772366.350244:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328bb7d8800 from 1 10000000:01000000:0.0:1790772366.350247:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772366.350290:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.350298:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.350308:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772366.350331:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317504:0@lo:101: 00000100:00100000:0.0:1790772366.350395:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.350434:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317504 00000100:00100000:0.0:1790772366.350434:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772366.350442:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317504 00000100:00100000:3.0:1790772366.350491:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790772366.350501:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+12:7643:x1877760813317504:12345-0@lo:101: 00010000:00010000:3.0:1790772366.350516:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772366.350529:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be13d7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.350571:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.350581:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.350590:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328813fd400, rc 0) 00000100:00100000:3.0:1790772366.350632:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317504:12345-0@lo:101: Request processed in 132us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.350639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772366.350725:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317504:0@lo:101: 00010000:00010000:0.0:1790772366.350746:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772366.350753:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772366.350817:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317632:0@lo:501: 00000100:00100000:0.0:1790772366.350836:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.350851:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772366.350871:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317632 00000100:00100000:3.0:1790772366.350905:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317632 00000100:00100000:3.0:1790772366.350927:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790772366.350933:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317632:12345-0@lo:501: 00000100:00100000:3.0:1790772366.351197:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317632:12345-0@lo:501: Request processed in 263us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.351204:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772366.353063:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317632:0@lo:501: 00000100:00100000:0.0:1790772366.353180:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317760:0@lo:503: 00000100:00100000:0.0:1790772366.353232:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.353259:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772366.353274:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317760 00000100:00100000:0.0:1790772366.353278:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317760 00000100:00100000:0.0:1790772366.353321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790772366.353329:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317760:12345-0@lo:503: 00000100:00100000:0.0:1790772366.356082:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317760:12345-0@lo:503: Request processed in 2598us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772366.356150:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790772366.356918:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317760:0@lo:503: 00000040:00080000:2.0:1790772366.357261:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772366.357349:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317888:0@lo:502: 00000100:00100000:2.0:1790772366.357411:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772366.357439:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772366.358717:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813317888 00000100:00100000:0.0:1790772366.358727:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813317888 00000100:00100000:0.0:1790772366.358793:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790772366.358803:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317888:12345-0@lo:502: 00000100:00100000:0.0:1790772366.359381:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813317888:12345-0@lo:502: Request processed in 577us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772366.359390:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790772366.359497:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813317888:0@lo:502: 00000040:00080000:2.0:1790772366.361153:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790772366.361208:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790772366.361243:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318016:0@lo:502: 00000100:00100000:2.0:1790772366.361297:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772366.361323:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772366.361432:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318016 00000100:00100000:0.0:1790772366.361438:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318016 00000100:00100000:0.0:1790772366.361478:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790772366.361486:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813318016:12345-0@lo:502: 00000100:00100000:0.0:1790772366.361672:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813318016:12345-0@lo:502: Request processed in 186us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772366.361680:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790772366.362026:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318016:0@lo:502: 00000040:00080000:2.0:1790772366.362097:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790772366.362105:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790772366.364392:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772366.364405:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772366.364407:0:7653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790772366.364414:0:7653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9328bb7d8800 00000020:00000080:0.0:1790772366.364418:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772366.364437:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772366.364440:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772366.364442:0:7653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790772366.364445:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790772366.364693:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790772366.364719:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772366.364780:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.364791:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772366.364831:0:7643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790772366.364834:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9328bb7d8800 10000000:01000000:2.0:1790772366.364838:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9328bb7d8800 10000000:01000000:2.0:1790772366.364842:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772366.364848:0:7643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9328bb7d8800 from 1 10000000:01000000:2.0:1790772366.364850:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772366.364918:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.364953:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.364965:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772366.364989:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318144:0@lo:101: 00000100:00100000:2.0:1790772366.365051:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772366.365093:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05f840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772366.365692:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318144 00000100:00100000:3.0:1790772366.365714:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318144 00000100:00100000:3.0:1790772366.365804:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790772366.365814:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813318144:12345-0@lo:101: 00010000:00010000:3.0:1790772366.365829:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772366.365841:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be13e5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.365862:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.365870:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.365899:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328813fc200, rc 0) 00000100:00100000:3.0:1790772366.365951:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318144:12345-0@lo:101: Request processed in 138us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.365958:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790772366.366055:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318144:0@lo:101: 00010000:00010000:2.0:1790772366.366072:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772366.366081:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772366.366176:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318272:0@lo:501: 00000100:00100000:2.0:1790772366.366205:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.369810:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318272 00000100:00100000:0.0:1790772366.369843:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318272 00000100:00100000:2.0:1790772366.369854:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05f840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772366.373207:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790772366.373220:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318272:12345-0@lo:501: 00000100:00100000:1.0:1790772366.373525:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318272:12345-0@lo:501: Request processed in 306us (7318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.373533:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790772366.374092:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318272:0@lo:501: 00000100:00100000:1.0:1790772366.374147:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318400:0@lo:503: 00000100:00100000:1.0:1790772366.374199:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.374227:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfaeccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772366.374492:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318400 00000100:00100000:3.0:1790772366.374500:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318400 00000100:00100000:3.0:1790772366.374634:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790772366.374643:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318400:12345-0@lo:503: 00000100:00100000:3.0:1790772366.374827:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318400:12345-0@lo:503: Request processed in 185us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.374833:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790772366.375026:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318400:0@lo:503: 00000040:00080000:0.0:1790772366.375296:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772366.375354:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318528:0@lo:502: 00000100:00100000:0.0:1790772366.375392:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772366.375450:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5240 going to sleep for 11 seconds 00000100:00100000:3.0:1790772366.375519:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318528 00000100:00100000:3.0:1790772366.375523:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318528 00000100:00100000:3.0:1790772366.375621:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790772366.375630:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318528:12345-0@lo:502: 00000100:00100000:3.0:1790772366.375820:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318528:12345-0@lo:502: Request processed in 191us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772366.375835:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790772366.375948:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318528:0@lo:502: 00000040:00080000:0.0:1790772366.376226:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790772366.376268:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790772366.376294:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790772366.376329:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790772366.376357:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790772366.376392:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790772366.376419:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790772366.376445:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790772366.376492:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790772366.376520:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790772366.376629:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790772366.376697:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790772366.376733:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790772366.376765:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790772366.376814:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790772366.376851:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790772366.376967:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790772366.377021:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790772366.377058:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790772366.377222:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790772366.377267:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790772366.377287:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790772366.377303:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790772366.377326:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790772366.377343:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790772366.377359:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790772366.377382:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790772366.377413:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790772366.377430:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790772366.377455:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790772366.377482:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790772366.377498:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790772366.377513:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790772366.377542:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790772366.377588:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790772366.377827:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790772366.377851:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790772366.378708:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318656:0@lo:502: 00000100:00100000:1.0:1790772366.378905:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772366.379039:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318656 00000100:00100000:2.0:1790772366.379046:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318656 00000100:00100000:2.0:1790772366.379088:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790772366.379098:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318656:12345-0@lo:502: 00000100:00100000:2.0:1790772366.379286:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813318656:12345-0@lo:502: Request processed in 189us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772366.379292:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790772366.379376:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfaecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772366.379399:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813318656:0@lo:502: 00000040:00080000:1.0:1790772366.379490:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1790772366.379504:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790772366.380826:0:7654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790772366.380843:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff932894b70000) 00000020:00000080:0.0:1790772366.380866:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790772366.380974:0:7654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9328bb7d8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790772366.380983:0:7654:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9328bb7d8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790772366.380986:0:7654:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328bb7d8800 3 00010000:00080000:0.0:1790772366.381014:0:7654:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93288f27a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1790772366.382654:0:7654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790772366.383021:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790772366.383054:0:7654:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790772366.383077:0:7654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd3c7635991be13fa 00000100:00080000:0.0:1790772366.383087:0:7654:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790772366.383097:0:7654:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93288f27a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1790772366.383132:0:7654:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff932888283100 x1877760813318784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772366.383163:0:7654:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790772366.383190:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1877760813318784:0@lo:38: 00000100:00100000:1.0:1790772366.383272:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.383330:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318784 00000100:00100000:1.0:1790772366.383336:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318784 00000100:00100000:1.0:1790772366.383364:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772366.383370:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1877760813318784:12345-0@lo:38: 00010000:00080000:1.0:1790772366.383390:0:5857:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1790772366.383427:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd3c7635991be1401 00000004:00100000:1.0:1790772366.383440:0:5857:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790772366.383467:0:5857:0:(import.c:65:import_set_state_nolock()) ffff93288830d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772366.383510:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877760813318784:12345-0@lo:38: Request processed in 138us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.383517:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790772366.383555:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888283100 x1877760813318784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772366.383585:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772366.383592:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790772366.383598:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790772366.383602:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790772366.383604:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93288f27a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772366.383624:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1877760813318784:0@lo:38: 00000100:00100000:2.0:1790772366.384853:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772366.384870:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813318912:0@lo:400: 00000100:00100000:1.0:1790772366.385116:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813319040:0@lo:400: 00000100:00100000:1.0:1790772366.385172:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.385201:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772366.385207:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813319168:0@lo:400: 00000100:00100000:1.0:1790772366.385230:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.385254:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319040 00000100:00100000:1.0:1790772366.385259:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319040 00000100:00100000:1.0:1790772366.385302:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772366.385311:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813319040:12345-0@lo:400: 00000100:00100000:1.0:1790772366.385354:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813319040:12345-0@lo:400: Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.385360:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772366.385392:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319168 00000100:00100000:1.0:1790772366.385396:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319168 00000100:00100000:1.0:1790772366.385422:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772366.385428:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813319168:12345-0@lo:400: 00000100:00100000:1.0:1790772366.385459:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813319168:12345-0@lo:400: Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.385465:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790772366.385487:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772366.385491:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790772366.385516:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d69500 x1877760813319168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772366.385529:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813319168:0@lo:400: 00010000:00080000:1.0:1790772366.385538:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d6b800 x1877760813319040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772366.385546:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813319040:0@lo:400: 00000100:00100000:2.0:1790772366.385656:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790772366.386955:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1790772366.387098:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813318912 00000100:00100000:1.0:1790772366.387105:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813318912 00000100:00100000:1.0:1790772366.387153:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772366.387162:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813318912:12345-0@lo:400: 00000100:00100000:1.0:1790772366.387236:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813318912:12345-0@lo:400: Request processed in 75us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772366.387238:0:7656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888280700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7656:1877760813319296:0@lo:901: 00000100:00100000:1.0:1790772366.387243:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000000:1.0:1790772366.387266:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:0.0:1790772366.387271:0:7656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1790772366.387293:0:7643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:3.0:1790772366.387327:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328b8d68380 x1877760813318912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772366.387340:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813318912:0@lo:400: 00000100:00100000:0.0:1790772366.387394:0:7656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5540 going to sleep for 11 seconds 00010000:00010000:1.0:1790772366.395500:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.395518:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772366.395529:0:5866:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319296 00000100:00100000:0.0:1790772366.395540:0:5866:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319296 00000100:00100000:0.0:1790772366.395628:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772366.395637:0:5866:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7656:x1877760813319296:12345-0@lo:901: 00000100:00080000:2.0:1790772366.395693:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1790772366.395828:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790772366.395830:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772366.395832:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772366.395833:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772366.395834:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772366.395836:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772366.395841:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772366.395842:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790772366.395843:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790772366.395845:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772366.395846:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772366.395851:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1790772366.395853:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772366.395854:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772366.395855:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772366.395856:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772366.395857:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772366.395858:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772366.395859:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772366.395859:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790772366.395860:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790772366.395861:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772366.395862:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772366.398986:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790772366.399009:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba716680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813319424:0@lo:253: 00000100:00100000:1.0:1790772366.399074:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.399121:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319424 00000100:00100000:1.0:1790772366.399128:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319424 00000100:00100000:1.0:1790772366.399174:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790772366.399189:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:7643:x1877760813319424:12345-0@lo:253: 20000000:01000000:1.0:1790772366.399233:0:5850:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790772366.399247:0:5850:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790772366.399505:0:5866:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7656:x1877760813319296:12345-0@lo:901: Request processed in 3868us (12230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772366.399519:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772366.399904:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfaecf00 going to sleep for 11 seconds 00010000:00080000:0.0:1790772366.401499:0:7656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff932888280700 x1877760813319296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790772382 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772366.401518:0:7656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888280700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7656:1877760813319296:0@lo:901: 20000000:01000000:1.0:1790772366.446494:0:5850:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790772366.446517:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790772366.446593:0:5871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790772366.446598:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790772366.446625:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.446644:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1352 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.446653:0:5871:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.446693:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1352 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.446707:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1352 expref: 14 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772366.446721:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1877760813319552:0@lo:104: 00000100:00100000:3.0:1790772366.446804:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772366.446853:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328aa8e8480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772366.447346:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319552 00000100:00100000:1.0:1790772366.447355:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319552 00000100:00100000:1.0:1790772366.447409:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772366.447418:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5871:x1877760813319552:12345-0@lo:104: 00010000:00010000:1.0:1790772366.447432:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.447508:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772366.447514:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:5871:x1877760813319552:12345-0@lo:104: Request processed in 98us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.447521:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790772366.447543:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772366.447550:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.447558:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772366.447571:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.447580:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772366.447587:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772366.447592:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1790772366.448061:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5871:1877760813319552:0@lo:104: 00010000:00010000:3.0:1790772366.448082:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448175:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448183:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772366.448210:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448217:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881519200/0xd3c7635991be1352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1359 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448244:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772366.448245:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772366.448247:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772366.448261:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772366.448274:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813319680:0@lo:103: 00000100:00100000:1.0:1790772366.448315:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772366.448349:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319680 00000100:00100000:1.0:1790772366.448354:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319680 00010000:00010000:1.0:1790772366.448372:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1352 expref: 15 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772366.448394:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772366.448400:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:3316:x1877760813319680:12345-0@lo:103: 00010000:00010000:1.0:1790772366.448411:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772366.448417:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1352 expref: 15 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448427:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1352 expref: 15 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448440:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881680c00/0xd3c7635991be1359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1352 expref: 15 pid: 5850 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448458:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448466:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790772366.448490:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001892725s 00010000:00010000:1.0:1790772366.448495:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448501:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448508:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448515:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448520:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fda00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772366.448524:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448531:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448542:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772366.448550:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772366.448595:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:3316:x1877760813319680:12345-0@lo:103: Request processed in 195us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.448604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790772366.449460:0:5871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.449471:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772366.449478:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fda00/0xd3c7635991be1408 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772366.449937:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813319680:0@lo:103: 00000100:00100000:1.0:1790772366.466557:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:7643:x1877760813319424:12345-0@lo:253: Request processed in 67359us (67472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772366.466594:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790772366.466751:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba716680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12e36d38-efd9-4a85-b7c8-c9520302915a:7643:1877760813319424:0@lo:253: 10000000:01000000:2.0:1790772366.466768:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790772366.466771:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772366.466772:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772366.466774:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772366.466775:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772366.466776:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772366.466778:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772366.466779:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772366.466781:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790772366.466783:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790772366.466785:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772366.466786:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772366.466803:0:7643:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790772366.471449:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772366.471714:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772366.471998:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772366.472195:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772366.472415:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772366.473394:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790772366.474811:0:7643:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790772366.823260:0:7643:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790772366.823270:0:7643:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790772366.823304:0:7643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772366.823369:0:7643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772366.823383:0:7643:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790772366.823416:0:7643:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790772367.115784:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772368.149597:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772368.588281:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813319808:0@lo:13: 00000100:00100000:0.0:1790772368.588397:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772368.588559:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319808 00000100:00100000:1.0:1790772368.588579:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319808 00000100:00100000:1.0:1790772368.588671:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772368.588683:0:6708:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1790772368.588684:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813319808:12345-0@lo:13: 00000100:00100000:0.0:1790772368.588693:0:6708:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1790772368.588734:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772368.588793:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813319808:12345-0@lo:13: Request processed in 112us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772368.588802:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790772368.588975:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba715180 x1877760813319808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772368.589014:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813319808:0@lo:13: 00000100:00080000:2.0:1790772368.589058:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772369.164234:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772370.193032:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772371.214302:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772371.661189:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813320064:0@lo:400: 00000100:00100000:1.0:1790772371.661291:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772371.661369:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772371.661376:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813319936:0@lo:400: 00000100:00100000:1.0:1790772371.661411:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772371.661438:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813320448:0@lo:400: 00000100:00100000:1.0:1790772371.661462:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772371.661506:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813320192:0@lo:400: 00000100:00100000:1.0:1790772371.661531:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772371.661549:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772371.661554:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813320320:0@lo:400: 00000100:00100000:1.0:1790772371.661611:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772371.661653:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320064 00000100:00100000:1.0:1790772371.661663:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320064 00000100:00100000:1.0:1790772371.661716:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320448 00000100:00100000:1.0:1790772371.661720:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320448 00000100:00100000:1.0:1790772371.661757:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320192 00000100:00100000:1.0:1790772371.661761:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320192 00000100:00100000:1.0:1790772371.661780:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772371.661789:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813320064:12345-0@lo:400: 00000100:00100000:1.0:1790772371.661858:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813320064:12345-0@lo:400: Request processed in 68us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772371.661865:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772371.661927:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772371.661934:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813320448:12345-0@lo:400: 00000100:00100000:1.0:1790772371.661963:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813320448:12345-0@lo:400: Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772371.661969:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772371.661982:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772371.661988:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813320192:12345-0@lo:400: 00000100:00100000:1.0:1790772371.662019:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813320192:12345-0@lo:400: Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772371.662024:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772371.662044:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813319936 00000100:00100000:1.0:1790772371.662048:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813319936 00000100:00100000:1.0:1790772371.662072:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790772371.662078:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3318:x1877760813319936:12345-0@lo:400: 00000100:00100000:1.0:1790772371.662107:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:3318:x1877760813319936:12345-0@lo:400: Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772371.662113:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790772371.662148:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320320 00000100:00100000:1.0:1790772371.662151:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320320 00000100:00100000:1.0:1790772371.662179:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772371.662192:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813320320:12345-0@lo:400: 00000100:00100000:1.0:1790772371.662225:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813320320:12345-0@lo:400: Request processed in 34us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772371.662232:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790772371.662249:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772371.662255:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790772371.662297:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba717b80 x1877760813320320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772371.662313:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813320320:0@lo:400: 00010000:00080000:1.0:1790772371.662325:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba717800 x1877760813320192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772371.662333:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813320192:0@lo:400: 00000100:00100000:1.0:1790772371.662371:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813319936:0@lo:400: 00010000:00080000:1.0:1790772371.662383:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba716a00 x1877760813320448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772371.662390:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813320448:0@lo:400: 00010000:00080000:1.0:1790772371.662401:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba717100 x1877760813320064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772371.662409:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813320064:0@lo:400: 00010000:00010000:1.0:1790772372.235320:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772373.270534:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772373.716276:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772373.716305:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813320576:0@lo:13: 00000100:00100000:3.0:1790772373.716377:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772373.716509:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320576 00000100:00100000:1.0:1790772373.716517:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320576 00000100:00100000:1.0:1790772373.716586:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772373.716596:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813320576:12345-0@lo:13: 00002000:00000024:1.0:1790772373.716648:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772373.716701:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813320576:12345-0@lo:13: Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772373.716709:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790772373.716756:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f91500 x1877760813320576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772373.716777:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813320576:0@lo:13: 00000100:00080000:3.0:1790772373.716970:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772374.284161:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772374.879410:0:7998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1790772375.243022:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790772375.243031:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9328ba5e9800 from 30 10000000:01000000:1.0:1790772375.243037:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790772375.243088:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.243103:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.243115:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.243149:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813320704:0@lo:101: 00000100:00100000:1.0:1790772375.243257:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.243327:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772375.243767:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320704 00000100:00100000:3.0:1790772375.243779:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320704 00000100:00100000:3.0:1790772375.243845:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790772375.243855:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813320704:12345-0@lo:101: 00010000:00010000:3.0:1790772375.243870:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772375.243954:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be140f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772375.243982:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be140f expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772375.243992:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be140f expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772375.244001:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328813fda00, rc 0) 00000100:00100000:3.0:1790772375.244051:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813320704:12345-0@lo:101: Request processed in 197us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.244058:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790772375.244229:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813320704:0@lo:101: 00010000:00010000:0.0:1790772375.244246:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.244255:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772375.244317:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813320832:0@lo:501: 00000100:00100000:0.0:1790772375.244350:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.244382:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.244461:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320832 00000100:00100000:1.0:1790772375.244467:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320832 00000100:00100000:1.0:1790772375.244498:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790772375.244504:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813320832:12345-0@lo:501: 00000100:00100000:1.0:1790772375.244933:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813320832:12345-0@lo:501: Request processed in 428us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.244950:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772375.246004:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813320832:0@lo:501: 00000100:00100000:0.0:1790772375.246056:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813320960:0@lo:503: 00000100:00100000:0.0:1790772375.246109:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.246149:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.246260:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813320960 00000100:00100000:1.0:1790772375.246267:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813320960 00000100:00100000:1.0:1790772375.246314:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790772375.246322:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813320960:12345-0@lo:503: 00000100:00100000:1.0:1790772375.246670:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813320960:12345-0@lo:503: Request processed in 348us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.246678:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790772375.248078:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813320960:0@lo:503: 00000100:00100000:0.0:1790772375.259373:0:8014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8014:1877760813321088:0@lo:502: 00000100:00100000:0.0:1790772375.259464:0:8014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.259580:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321088 00000100:00100000:1.0:1790772375.259589:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321088 00000100:00100000:1.0:1790772375.259643:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790772375.259654:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8014:x1877760813321088:12345-0@lo:502: 00000100:00100000:0.0:1790772375.259707:0:8014:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5540 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.260022:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8014:x1877760813321088:12345-0@lo:502: Request processed in 369us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.260029:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790772375.260130:0:8014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8014:1877760813321088:0@lo:502: 00000100:00100000:0.0:1790772375.260180:0:8014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8014:1877760813321216:0@lo:502: 00000100:00100000:0.0:1790772375.260213:0:8014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.260231:0:8014:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5540 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.260263:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321216 00000100:00100000:1.0:1790772375.260268:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321216 00000100:00100000:1.0:1790772375.260293:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790772375.260300:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8014:x1877760813321216:12345-0@lo:502: 00000100:00100000:1.0:1790772375.260444:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8014:x1877760813321216:12345-0@lo:502: Request processed in 143us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.260451:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790772375.260468:0:8014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8014:1877760813321216:0@lo:502: 00000040:00080000:0.0:1790772375.260486:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790772375.261556:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790772375.261582:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790772375.261595:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.261619:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772375.261629:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790772375.261632:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1790772375.261634:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772375.261659:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.261664:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.261671:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.261683:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321344:0@lo:101: 00000100:00100000:1.0:1790772375.261725:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.261765:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.261869:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321344 00000100:00100000:0.0:1790772375.261890:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321344 00000100:00100000:0.0:1790772375.261930:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790772375.261938:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813321344:12345-0@lo:101: 00010000:00010000:0.0:1790772375.261950:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772375.261963:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be141d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.261984:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be141d expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.261993:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be141d expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.262000:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030200, rc 0) 00000100:00100000:1.0:1790772375.263076:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321344:0@lo:101: 00010000:00010000:1.0:1790772375.263099:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.263109:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.263173:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321472:0@lo:501: 00000100:00100000:0.0:1790772375.264332:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813321344:12345-0@lo:101: Request processed in 98us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.264351:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790772375.267582:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.267643:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8600 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.268040:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321472 00000100:00100000:2.0:1790772375.268049:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321472 00000100:00100000:2.0:1790772375.268107:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790772375.268117:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813321472:12345-0@lo:501: 00000100:00100000:2.0:1790772375.268440:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813321472:12345-0@lo:501: Request processed in 324us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.268447:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790772375.268592:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321472:0@lo:501: 00000100:00100000:0.0:1790772375.268643:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321600:0@lo:503: 00000100:00100000:0.0:1790772375.268684:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.268726:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.268728:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321600 00000100:00100000:1.0:1790772375.268732:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321600 00000100:00100000:1.0:1790772375.268764:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790772375.268772:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813321600:12345-0@lo:503: 00000100:00100000:1.0:1790772375.269106:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813321600:12345-0@lo:503: Request processed in 333us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.269113:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790772375.269135:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321600:0@lo:503: 00000100:00100000:0.0:1790772375.272380:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8017:1877760813321728:0@lo:502: 00000100:00100000:0.0:1790772375.272477:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.272532:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.272557:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321728 00000100:00100000:2.0:1790772375.272566:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321728 00000100:00100000:2.0:1790772375.272619:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790772375.272630:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8017:x1877760813321728:12345-0@lo:502: 00000100:00100000:2.0:1790772375.272942:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8017:x1877760813321728:12345-0@lo:502: Request processed in 313us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.272950:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790772375.273796:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8017:1877760813321728:0@lo:502: 00000020:01000000:0.0:1790772375.273830:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772375.273841:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772375.273843:0:8017:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790772375.273849:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790772375.273851:0:8017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790772375.273891:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8017:1877760813321856:0@lo:502: 00000100:00100000:0.0:1790772375.273951:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772375.273981:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321856 00000100:00100000:0.0:1790772375.273983:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.273987:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321856 00000100:00100000:2.0:1790772375.274025:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790772375.274034:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8017:x1877760813321856:12345-0@lo:502: 00000100:00100000:2.0:1790772375.274227:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8017:x1877760813321856:12345-0@lo:502: Request processed in 193us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.274234:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790772375.274599:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8017:1877760813321856:0@lo:502: 00000020:01000000:0.0:1790772375.274620:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772375.274626:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772375.274628:0:8017:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790772375.274631:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790772375.274727:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790772375.274754:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790772375.274765:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.274777:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772375.274787:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790772375.274789:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff932891b62000 from 30 10000000:01000000:1.0:1790772375.274792:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790772375.274820:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.274828:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.274838:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.274851:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321984:0@lo:101: 00000100:00100000:1.0:1790772375.274921:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.274953:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.275836:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813321984 00000100:00100000:0.0:1790772375.275846:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813321984 00000100:00100000:0.0:1790772375.275913:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790772375.275924:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813321984:12345-0@lo:101: 00010000:00010000:0.0:1790772375.275939:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772375.275954:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be142b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.275980:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be142b expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.275991:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be142b expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.276000:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880031e00, rc 0) 00000100:00100000:0.0:1790772375.276279:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813321984:12345-0@lo:101: Request processed in 357us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.276287:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790772375.276305:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813321984:0@lo:101: 00010000:00010000:1.0:1790772375.276322:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.276331:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.276385:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322112:0@lo:501: 00000100:00100000:1.0:1790772375.276424:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.276532:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.276587:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322112 00000100:00100000:2.0:1790772375.276592:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322112 00000100:00100000:2.0:1790772375.276628:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790772375.276635:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813322112:12345-0@lo:501: 00000100:00100000:2.0:1790772375.276990:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813322112:12345-0@lo:501: Request processed in 353us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.276998:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790772375.277175:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322112:0@lo:501: 00000100:00100000:1.0:1790772375.277567:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322240:0@lo:503: 00000100:00100000:1.0:1790772375.277610:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.277648:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.278320:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322240 00000100:00100000:2.0:1790772375.278336:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322240 00000100:00100000:2.0:1790772375.278375:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790772375.278383:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813322240:12345-0@lo:503: 00000100:00100000:2.0:1790772375.279739:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813322240:12345-0@lo:503: Request processed in 1353us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.279750:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790772375.296902:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322240:0@lo:503: 00000100:00100000:1.0:1790772375.297227:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8019:1877760813322368:0@lo:502: 00000100:00100000:1.0:1790772375.297301:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.297354:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.302026:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322368 00000100:00100000:0.0:1790772375.302044:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322368 00000100:00100000:0.0:1790772375.302121:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790772375.302131:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8019:x1877760813322368:12345-0@lo:502: 00000100:00100000:0.0:1790772375.302713:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8019:x1877760813322368:12345-0@lo:502: Request processed in 582us (5410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.302722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790772375.302834:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8019:1877760813322368:0@lo:502: 00000100:00100000:3.0:1790772375.302980:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8019:1877760813322496:0@lo:502: 00000100:00100000:3.0:1790772375.303029:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.303056:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b93133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.307061:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322496 00000100:00100000:0.0:1790772375.307077:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322496 00000100:00100000:0.0:1790772375.307133:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790772375.307144:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8019:x1877760813322496:12345-0@lo:502: 00000100:00100000:0.0:1790772375.308117:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8019:x1877760813322496:12345-0@lo:502: Request processed in 971us (5084us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.308127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790772375.308327:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8019:1877760813322496:0@lo:502: 00000040:00080000:3.0:1790772375.308365:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790772375.309142:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790772375.309164:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772375.309174:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.309197:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772375.309208:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790772375.309210:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff932891b62000 from 5 10000000:01000000:0.0:1790772375.309214:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790772375.309257:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.309266:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.309275:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772375.309293:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322624:0@lo:101: 00000100:00100000:1.0:1790772375.309824:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.309871:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.310978:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322624 00000100:00100000:0.0:1790772375.310988:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322624 00000100:00100000:0.0:1790772375.311035:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790772375.311044:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813322624:12345-0@lo:101: 00010000:00010000:0.0:1790772375.311058:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772375.311076:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030000/0xd3c7635991be1440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1439 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.311100:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030000/0xd3c7635991be1440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1439 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.311111:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030000/0xd3c7635991be1440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1439 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.311121:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030000, rc 0) 00000100:00100000:0.0:1790772375.311170:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813322624:12345-0@lo:101: Request processed in 126us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.311187:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790772375.311296:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322624:0@lo:101: 00010000:00010000:1.0:1790772375.311324:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.311334:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.311416:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322752:0@lo:256: 00000100:00100000:1.0:1790772375.311464:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.311496:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.311774:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322752 00000100:00100000:0.0:1790772375.311779:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322752 00000100:00100000:0.0:1790772375.311822:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790772375.311829:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813322752:12345-0@lo:256: 20000000:01000000:0.0:1790772375.311842:0:5850:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790772375.311869:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790772375.311892:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790772375.311968:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813322752:12345-0@lo:256: Request processed in 140us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.311976:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790772375.312169:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322752:0@lo:256: 10000000:01000000:1.0:1790772375.312225:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772375.312233:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.312242:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772375.312250:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790772375.312252:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790772375.312255:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772375.312276:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.312283:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.312291:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.312305:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322880:0@lo:101: 00000100:00100000:1.0:1790772375.313085:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.313427:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8840 going to sleep for 11 seconds 00010000:00010000:0.0:1790772375.319562:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772375.325318:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813322880 00000100:00100000:3.0:1790772375.325337:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813322880 00000100:00100000:3.0:1790772375.325402:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790772375.325422:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813322880:12345-0@lo:101: 00010000:00010000:3.0:1790772375.325439:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772375.325458:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1447 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772375.325501:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1447 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772375.325864:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1447 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772375.325938:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328813fc400, rc 0) 00000100:00100000:0.0:1790772375.326059:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813322880:0@lo:101: 00010000:00010000:0.0:1790772375.326080:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.326090:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772375.326102:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813322880:12345-0@lo:101: Request processed in 625us (12951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.326110:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790772375.326163:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813323008:0@lo:501: 00000100:00100000:0.0:1790772375.326196:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.326239:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.326281:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323008 00000100:00100000:2.0:1790772375.326285:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323008 00000100:00100000:2.0:1790772375.326310:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790772375.326325:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813323008:12345-0@lo:501: 00000100:00100000:2.0:1790772375.326762:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813323008:12345-0@lo:501: Request processed in 446us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.326770:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790772375.327089:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813323008:0@lo:501: 00000100:00100000:0.0:1790772375.327123:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813323136:0@lo:503: 00000100:00100000:0.0:1790772375.327165:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.327194:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772375.327716:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323136 00000100:00100000:3.0:1790772375.327724:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323136 00000100:00100000:3.0:1790772375.327766:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790772375.328178:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813323136:12345-0@lo:503: 00000100:00100000:3.0:1790772375.330269:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813323136:12345-0@lo:503: Request processed in 2486us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.330285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790772375.330303:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813323136:0@lo:503: 00000100:00100000:3.0:1790772375.331779:0:8021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8021:1877760813323264:0@lo:502: 00000100:00100000:3.0:1790772375.331856:0:8021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.331922:0:8021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b93130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772375.331990:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323264 00000100:00100000:2.0:1790772375.331997:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323264 00000100:00100000:2.0:1790772375.332046:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790772375.332057:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8021:x1877760813323264:12345-0@lo:502: 00000100:00100000:3.0:1790772375.333687:0:8021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8021:1877760813323264:0@lo:502: 00000020:01000000:3.0:1790772375.333726:0:8021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790772375.333734:0:8021:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790772375.333742:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772375.333744:0:8021:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790772375.333749:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790772375.333760:0:8021:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1790772375.333785:0:8021:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790772375.333788:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790772375.333804:0:8021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9328b9bf4d40) 00000020:00000080:3.0:1790772375.333826:0:8021:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1790772375.333832:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790772375.333939:0:8021:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790772375.333946:0:8021:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790772375.333954:0:8021:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be145c 00010000:00080000:3.0:1790772375.333986:0:8021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932883150000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1790772375.334202:0:8021:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000100:00100000:2.0:1790772375.334695:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8021:x1877760813323264:12345-0@lo:502: Request processed in 343us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.334706:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000040:01000000:3.0:1790772375.337326:0:8021:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790772375.337347:0:8021:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790772375.337970:0:8021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772375.338181:0:8021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772375.338232:0:8021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790772375.338292:0:8021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1790772375.340923:0:8022:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772375.340931:0:8022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790772375.342306:0:8021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790772375.342373:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790772375.342417:0:8021:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790772375.342439:0:8021:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be1463 00000100:00080000:3.0:1790772375.342450:0:8021:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772375.342462:0:8021:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932883150000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1790772375.342498:0:8021:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328831c4e00 x1877760813323392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772375.342562:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813323392:0@lo:8: 00000100:00100000:1.0:1790772375.342642:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790772375.342718:0:8021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1790772375.342821:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813323904:0@lo:400: 00000100:00100000:3.0:1790772375.342868:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.342915:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772375.342929:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813323776:0@lo:400: 00000100:00100000:3.0:1790772375.342955:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1790772375.343008:0:8021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772375.343013:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772375.343015:0:8021:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790772375.343018:0:8021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772375.343022:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772375.343023:0:8021:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772375.343025:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772375.343027:0:8021:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790772375.343065:0:8021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8021:1877760813324032:0@lo:502: 00000100:00100000:3.0:1790772375.343108:0:8021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.343134:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324032 00000100:00100000:3.0:1790772375.343140:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324032 00000100:00100000:3.0:1790772375.343181:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790772375.343190:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8021:x1877760813324032:12345-0@lo:502: 00000100:00100000:0.0:1790772375.343427:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323392 00000100:00100000:0.0:1790772375.343439:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323392 00000100:00100000:0.0:1790772375.343460:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323776 00000100:00100000:0.0:1790772375.343463:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323776 00000100:00100000:0.0:1790772375.343494:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772375.343501:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813323776:12345-0@lo:400: 00000100:00100000:0.0:1790772375.343554:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813323776:12345-0@lo:400: Request processed in 54us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.343561:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772375.343579:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772375.343584:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1877760813323392:12345-0@lo:8: 00010000:00080000:0.0:1790772375.343603:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1790772375.343629:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be146a 00002000:00100000:0.0:1790772375.343641:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93288f0a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790772375.343646:0:6706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1790772375.343649:0:6706:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790772375.343761:0:6706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790772375.343932:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790772375.343953:0:6706:0:(import.c:65:import_set_state_nolock()) ffff93288f0a3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772375.345347:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8021:x1877760813324032:12345-0@lo:502: Request processed in 2152us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.345358:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790772375.345430:0:8021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ba6d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772375.345454:0:8021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8021:1877760813324032:0@lo:502: 00000020:01000000:3.0:1790772375.345485:0:8021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772375.345493:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772375.345495:0:8021:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790772375.345500:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1790772375.346263:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323904 00000100:00100000:3.0:1790772375.346270:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323904 00000100:00100000:3.0:1790772375.346310:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772375.346344:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813323904:12345-0@lo:400: 00000100:00100000:3.0:1790772375.346422:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813323904:12345-0@lo:400: Request processed in 79us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.346428:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772375.346457:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813323648:0@lo:400: 00000100:00100000:3.0:1790772375.346493:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.346518:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772375.346524:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813323520:0@lo:400: 00000100:00100000:3.0:1790772375.346543:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.346567:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323648 00000100:00100000:3.0:1790772375.346571:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323648 00000100:00100000:3.0:1790772375.346586:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813323520 00000100:00100000:3.0:1790772375.346588:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813323520 00000100:00100000:3.0:1790772375.346599:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772375.346605:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813323648:12345-0@lo:400: 00000100:00100000:3.0:1790772375.346632:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813323648:12345-0@lo:400: Request processed in 28us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.346636:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772375.346644:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772375.346648:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813323520:12345-0@lo:400: 00000100:00100000:3.0:1790772375.346662:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813323520:12345-0@lo:400: Request processed in 15us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.346666:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790772375.346684:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c6300 x1877760813323520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772375.346692:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813323520:0@lo:400: 00010000:00080000:3.0:1790772375.346698:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c4700 x1877760813323648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772375.346708:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813323648:0@lo:400: 00000100:00100000:0.0:1790772375.347339:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1877760813323392:12345-0@lo:8: Request processed in 3752us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.347346:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790772375.347366:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772375.347369:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1790772375.347375:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1790772375.347392:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790772375.347400:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.347432:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772375.347442:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790772375.347445:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff932894b719c0 from 1 10000000:01000000:0.0:1790772375.347448:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790772375.347499:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1790772375.347506:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c4e00 x1877760813323392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790772375.347508:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.347517:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:0.0:1790772375.347519:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790772375.347524:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790772375.347531:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1790772375.347534:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813324160:0@lo:101: 00000100:00080000:1.0:1790772375.347536:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790772375.347539:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932883150000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790772375.347559:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790772375.347565:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813323392:0@lo:8: 00000100:00100000:0.0:1790772375.347568:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1790772375.347630:0:8022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790772375.347762:0:8022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196167885840ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790772375.347762:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5480 going to sleep for 11 seconds 00010000:00080000:0.0:1790772375.348310:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c7b80 x1877760813323776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772375.349551:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813323776:0@lo:400: 00010000:00080000:0.0:1790772375.349584:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c7480 x1877760813323904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772375.349592:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813323904:0@lo:400: 00000100:00100000:2.0:1790772375.350497:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324160 00000100:00100000:2.0:1790772375.350508:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324160 00000100:00100000:2.0:1790772375.350562:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790772375.350572:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813324160:12345-0@lo:101: 00010000:00010000:2.0:1790772375.350592:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772375.350609:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1471 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772375.350652:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1471 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772375.350664:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1471 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772375.350673:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519200, rc 0) 00000100:00100000:2.0:1790772375.350749:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813324160:12345-0@lo:101: Request processed in 178us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772375.350756:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790772375.351319:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813324160:0@lo:101: 00010000:00010000:1.0:1790772375.351340:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772375.351350:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772375.351421:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813324288:0@lo:501: 00000100:00100000:1.0:1790772375.351463:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.351494:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.351508:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324288 00000100:00100000:1.0:1790772375.351511:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324288 00000100:00100000:1.0:1790772375.351543:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790772375.351550:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813324288:12345-0@lo:501: 00000100:00100000:1.0:1790772375.351731:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813324288:12345-0@lo:501: Request processed in 181us (267us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772375.351738:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790772375.351954:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813324288:0@lo:501: 10000000:01000000:0.0:1790772375.352005:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790772375.352019:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772375.352027:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772375.433152:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790772375.504642:0:8023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790772375.504678:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813324544:0@lo:7: 00000100:00100000:1.0:1790772375.504752:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.504797:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf60a600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.504813:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813324416:0@lo:13: 00000100:00100000:1.0:1790772375.504838:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772375.504909:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324544 00000100:00100000:1.0:1790772375.504917:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324544 00000100:00100000:1.0:1790772375.504971:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772375.504980:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1877760813324544:12345-0@lo:7: 00000100:00100000:0.0:1790772375.508445:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324416 00000100:00100000:0.0:1790772375.508469:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324416 00000100:00100000:0.0:1790772375.508538:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772375.508548:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877760813324416:12345-0@lo:13: 00002000:00000024:0.0:1790772375.508584:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790772375.508679:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1877760813324416:12345-0@lo:13: Request processed in 132us (3839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772375.508687:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790772375.508975:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1790772375.519933:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1790772375.519941:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790772375.520040:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1877760813324544:12345-0@lo:7: Request processed in 15058us (15285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.520052:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790772375.520120:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90e00 x1877760813324416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772375.520143:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813324416:0@lo:13: 00010000:00080000:0.0:1790772375.522713:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90700 x1877760813324544/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790772391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772375.522733:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813324544:0@lo:7: 00000004:00080000:0.0:1790772375.522748:0:8023:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790772375.522903:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813324672:0@lo:5: 00000100:00100000:3.0:1790772375.522971:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.523049:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.523160:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324672 00000100:00100000:0.0:1790772375.523168:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324672 00000100:00100000:0.0:1790772375.523225:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772375.523237:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8023:x1877760813324672:12345-0@lo:5: 00002000:00080000:0.0:1790772375.523267:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790772375.523271:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790772375.523669:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8023:x1877760813324672:12345-0@lo:5: Request processed in 433us (695us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790772375.523677:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790772375.526279:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c4700 x1877760813324672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772375.526301:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813324672:0@lo:5: 00000004:00080000:3.0:1790772375.526329:0:8023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790772375.526379:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813324800:0@lo:700: 00000100:00100000:3.0:1790772375.526460:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.526489:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.526775:0:6712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324800 00000100:00100000:0.0:1790772375.526795:0:6712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324800 00000100:00100000:0.0:1790772375.526904:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772375.526914:0:6712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8023:x1877760813324800:12345-0@lo:700: 00000100:00100000:0.0:1790772375.526947:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6712:1877760813324928:0@lo:700: 00000100:00100000:0.0:1790772375.526977:0:6712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772375.526996:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772375.527010:0:5862:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813324928 00000100:00100000:0.0:1790772375.527013:0:5862:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813324928 00000100:00100000:0.0:1790772375.527054:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772375.527061:0:5862:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6712:x1877760813324928:12345-0@lo:700: 40000000:02000000:0.0:1790772375.604241:0:5862:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1790772375.608677:0:5862:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6712:x1877760813324928:12345-0@lo:700: Request processed in 81609us (81691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772375.608696:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790772375.608784:0:6712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888282d80 x1877760813324928/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790772391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772375.608799:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6712:1877760813324928:0@lo:700: 40000000:02000000:0.0:1790772375.608812:0:6712:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1790772375.661796:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1790772375.661814:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790772375.662060:0:6712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8023:x1877760813324800:12345-0@lo:700: Request processed in 135144us (135606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772375.662073:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790772375.662083:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c4380 x1877760813324800/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790772391 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772375.662093:0:8023:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790772375.662110:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813324800:0@lo:700: 00000004:02000040:1.0:1790772375.726933:0:8023:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790772375.736433:0:8023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813325056:0@lo:5: 00000100:00100000:3.0:1790772375.740234:0:8023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772375.740419:0:8023:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f05fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772375.745460:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325056 00000100:00100000:1.0:1790772375.745478:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325056 00000100:00100000:1.0:1790772375.745708:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772375.745719:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8023:x1877760813325056:12345-0@lo:5: 00002000:00080000:1.0:1790772375.756218:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1790772375.756241:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1790772375.761220:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1877760813325056:12345-0@lo:5: Request processed in 15497us (20988us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790772375.761234:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790772375.761287:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c7b80 x1877760813325056/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772391 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772375.761304:0:8023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1877760813325056:0@lo:5: 00000004:00080000:1.0:1790772375.761320:0:8023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1790772376.337053:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772377.355386:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772378.378975:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772378.827227:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813325184:0@lo:13: 00000100:00100000:2.0:1790772378.827317:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772378.827420:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325184 00000100:00100000:2.0:1790772378.827428:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325184 00000100:00100000:2.0:1790772378.827490:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772378.827503:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813325184:12345-0@lo:13: 00002000:00000024:2.0:1790772378.827552:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772378.827604:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813325184:12345-0@lo:13: Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772378.827610:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790772378.827630:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790772378.827662:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90e00 x1877760813325184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772378.827685:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813325184:0@lo:13: 00010000:00010000:2.0:1790772379.403604:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790772380.324240:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1790772380.368932:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813325312:0@lo:400: 00000100:00100000:0.0:1790772380.369013:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772380.369061:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813325824:0@lo:400: 00000100:00100000:0.0:1790772380.369085:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772380.369111:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790772380.369117:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813325440:0@lo:400: 00000100:00100000:0.0:1790772380.369154:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772380.369174:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813325952:0@lo:400: 00000100:00100000:0.0:1790772380.369199:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772380.369237:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813325568:0@lo:400: 00000100:00100000:0.0:1790772380.369261:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772380.369279:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772380.369284:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813325696:0@lo:400: 00000100:00100000:0.0:1790772380.369304:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772380.372130:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325824 00000100:00100000:1.0:1790772380.372146:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325824 00000100:00100000:1.0:1790772380.372351:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325440 00000100:00100000:1.0:1790772380.372356:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325440 00000100:00080000:3.0:1790772380.372443:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772380.377441:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325568 00000100:00100000:1.0:1790772380.377456:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325568 00000100:00100000:1.0:1790772380.377518:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772380.377529:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813325824:12345-0@lo:400: 00000100:00100000:1.0:1790772380.377642:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813325824:12345-0@lo:400: Request processed in 115us (8555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772380.377650:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772380.377668:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772380.377704:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813325440:12345-0@lo:400: 00000100:00100000:1.0:1790772380.377740:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813325440:12345-0@lo:400: Request processed in 38us (8585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772380.377746:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772380.377759:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772380.377765:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813325568:12345-0@lo:400: 00000100:00100000:1.0:1790772380.377800:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813325568:12345-0@lo:400: Request processed in 35us (8537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772380.377806:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772380.377831:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325312 00000100:00100000:1.0:1790772380.377836:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325312 00000100:00100000:1.0:1790772380.377862:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790772380.377869:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813325312:12345-0@lo:400: 00000100:00100000:1.0:1790772380.377932:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813325312:12345-0@lo:400: Request processed in 64us (8919us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772380.377937:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1790772380.380167:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772380.385409:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888283800 x1877760813325440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772380.385427:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813325440:0@lo:400: 00000100:00100000:0.0:1790772380.385440:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813325312:0@lo:400: 00010000:00080000:0.0:1790772380.385450:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888282300 x1877760813325824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772380.385458:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813325824:0@lo:400: 00000100:00100000:0.0:1790772380.385497:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325952 00000100:00100000:0.0:1790772380.385504:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325952 00000100:00100000:0.0:1790772380.385563:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813325696 00000100:00100000:0.0:1790772380.385567:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813325696 00000100:00100000:0.0:1790772380.385585:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772380.385594:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813325952:12345-0@lo:400: 00000100:00100000:0.0:1790772380.385681:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813325952:12345-0@lo:400: Request processed in 87us (16480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772380.385700:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772380.385716:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772380.385722:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813325696:12345-0@lo:400: 00000100:00100000:0.0:1790772380.385752:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813325696:12345-0@lo:400: Request processed in 31us (16447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772380.385757:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790772380.385833:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888283100 x1877760813325696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772380.385844:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813325696:0@lo:400: 00010000:00080000:0.0:1790772380.385856:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888281880 x1877760813325568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772380.385863:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813325568:0@lo:400: 00010000:00080000:0.0:1790772380.386014:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888281180 x1877760813325952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772380.386022:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790772380.386031:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813325952:0@lo:400: 00000100:00080000:1.0:1790772380.386590:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772380.386595:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790772380.429515:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772380.880157:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813326080:0@lo:13: 00000100:00100000:0.0:1790772380.880232:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772380.880321:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326080 00000100:00100000:0.0:1790772380.880328:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326080 00000100:00100000:0.0:1790772380.880382:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772380.880391:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813326080:12345-0@lo:13: 00002000:00000024:0.0:1790772380.880427:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772380.880477:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813326080:12345-0@lo:13: Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772380.880484:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790772380.880529:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f93b80 x1877760813326080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772380.880548:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813326080:0@lo:13: 00000100:00100000:1.0:1790772380.994937:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772380.995027:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796524672 00000100:00100000:3.0:1790772380.995038:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796524672 00000100:00100000:3.0:1790772380.995088:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1790772380.995113:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1877760796524672:12345-192.168.201.34@tcp:250: 00010000:00080000:3.0:1790772380.995143:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd@192.168.201.34@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1790772380.995171:0:5848:0:(genops.c:1384:class_connect()) connect: client 2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd, cookie 0xd3c7635991be147f 00000100:00080000:3.0:1790772380.995328:0:5848:0:(import.c:65:import_set_state_nolock()) ffff93288f278800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772380.995401:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+5:2353:x1877760796524672:12345-192.168.201.34@tcp:250: Request processed in 288us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772380.995408:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:2.0:1790772381.005420:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772381.005528:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796524800 00000100:00100000:1.0:1790772381.005541:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796524800 00000100:00100000:1.0:1790772381.005615:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:1.0:1790772381.005625:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+5:5582:x1877760796524800:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1790772381.005646:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772381.005665:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50721 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772381.005710:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772381.005722:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772381.005732:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881681200, rc 0) 00000100:00100000:1.0:1790772381.005787:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+6:5582:x1877760796524800:12345-192.168.201.34@tcp:101: Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772381.005795:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:1.0:1790772381.020779:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772381.020815:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796524928 00000100:00100000:1.0:1790772381.020825:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796524928 00000100:00100000:1.0:1790772381.020974:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1790772381.020986:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+6:5582:x1877760796524928:12345-192.168.201.34@tcp:501: 00000100:00100000:1.0:1790772381.021448:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+6:5582:x1877760796524928:12345-192.168.201.34@tcp:501: Request processed in 463us (681us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772381.021458:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1790772381.025289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772381.025416:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525056 00000100:00100000:2.0:1790772381.025427:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525056 00000100:00100000:2.0:1790772381.025481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:2.0:1790772381.025490:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+6:5582:x1877760796525056:12345-192.168.201.34@tcp:101: 00010000:00010000:2.0:1790772381.025509:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772381.025527:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50728 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772381.025559:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772381.025576:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772381.025716:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518800, rc 0) 00000100:00100000:2.0:1790772381.026082:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+7:5582:x1877760796525056:12345-192.168.201.34@tcp:101: Request processed in 586us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772381.026092:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:1.0:1790772381.047288:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772381.053546:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525184 00000100:00100000:2.0:1790772381.053562:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525184 00000100:00100000:2.0:1790772381.053637:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:2.0:1790772381.053648:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+7:5582:x1877760796525184:12345-192.168.201.34@tcp:501: 00000100:00100000:2.0:1790772381.053925:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5582:x1877760796525184:12345-192.168.201.34@tcp:501: Request processed in 278us (6646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772381.053934:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:2.0:1790772381.067506:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772381.067561:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525312 00000100:00100000:3.0:1790772381.067572:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525312 00000100:00100000:3.0:1790772381.067774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1790772381.067784:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5582:x1877760796525312:12345-192.168.201.34@tcp:503: 00000100:00100000:3.0:1790772381.068227:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5582:x1877760796525312:12345-192.168.201.34@tcp:503: Request processed in 443us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772381.068236:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:1.0:1790772381.085755:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772381.086367:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525440 00000100:00100000:3.0:1790772381.086379:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525440 00000100:00100000:3.0:1790772381.086446:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:3.0:1790772381.086457:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5601:x1877760796525440:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1790772381.086820:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5601:x1877760796525440:12345-192.168.201.34@tcp:502: Request processed in 364us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772381.086828:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1790772381.139195:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772381.139282:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525568 00000100:00100000:3.0:1790772381.139295:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525568 00000100:00100000:3.0:1790772381.139371:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1790772381.139381:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5601:x1877760796525568:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1790772381.139685:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5601:x1877760796525568:12345-192.168.201.34@tcp:502: Request processed in 305us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772381.139694:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1790772381.148632:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772381.148740:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525696 00000100:00100000:1.0:1790772381.148752:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525696 00000100:00100000:1.0:1790772381.148811:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:1.0:1790772381.148822:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5582:x1877760796525696:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1790772381.148840:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772381.148923:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881680a00/0xd3c7635991be1494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50752 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772381.148956:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881680a00/0xd3c7635991be1494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50752 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772381.148967:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881680a00/0xd3c7635991be1494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50752 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772381.148978:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881680a00, rc 0) 00000100:00100000:1.0:1790772381.149039:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5582:x1877760796525696:12345-192.168.201.34@tcp:101: Request processed in 219us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772381.149046:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:1.0:1790772381.167546:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772381.167661:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525824 00000100:00100000:2.0:1790772381.167672:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525824 00000100:00100000:2.0:1790772381.167731:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:2.0:1790772381.167742:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5582:x1877760796525824:12345-192.168.201.34@tcp:256: 20000000:01000000:2.0:1790772381.167773:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790772381.167800:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790772381.167804:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790772381.167806:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790772381.167809:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790772381.178388:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5582:x1877760796525824:12345-192.168.201.34@tcp:256: Request processed in 10633us (10837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772381.178406:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:3.0:1790772381.192563:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772381.192672:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796525952 00000100:00100000:2.0:1790772381.192684:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796525952 00000100:00100000:2.0:1790772381.192743:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1790772381.192753:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5582:x1877760796525952:12345-192.168.201.34@tcp:101: 00010000:00010000:2.0:1790772381.192771:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772381.192790:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50759 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772381.192820:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772381.192837:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772381.192847:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519600, rc 0) 00000100:00100000:2.0:1790772381.192949:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5582:x1877760796525952:12345-192.168.201.34@tcp:101: Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772381.192970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:1.0:1790772381.196213:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772381.197933:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526080 00000100:00100000:2.0:1790772381.197948:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526080 00000100:00100000:2.0:1790772381.198028:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:2.0:1790772381.198038:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5582:x1877760796526080:12345-192.168.201.34@tcp:501: 00000100:00100000:2.0:1790772381.198331:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5582:x1877760796526080:12345-192.168.201.34@tcp:501: Request processed in 294us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772381.198340:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:0.0:1790772381.201116:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772381.203328:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526208 00000100:00100000:1.0:1790772381.203409:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526208 00000100:00100000:1.0:1790772381.203607:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:1.0:1790772381.203618:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5582:x1877760796526208:12345-192.168.201.34@tcp:503: 00000100:00100000:1.0:1790772381.204079:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5582:x1877760796526208:12345-192.168.201.34@tcp:503: Request processed in 461us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772381.204087:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:0.0:1790772381.208184:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772381.208865:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526336 00000100:00100000:3.0:1790772381.208931:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526336 00000100:00100000:3.0:1790772381.209011:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1790772381.209023:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5605:x1877760796526336:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1790772381.209338:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5605:x1877760796526336:12345-192.168.201.34@tcp:502: Request processed in 316us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772381.209347:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1790772381.218531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772381.218668:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526464 00000100:00100000:1.0:1790772381.218678:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526464 00000100:00100000:1.0:1790772381.218768:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:1.0:1790772381.218778:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5605:x1877760796526464:12345-192.168.201.34@tcp:502: 00000100:00100000:1.0:1790772381.219055:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5605:x1877760796526464:12345-192.168.201.34@tcp:502: Request processed in 278us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772381.219072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:0.0:1790772381.222476:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772381.222617:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526592 00000100:00100000:1.0:1790772381.222629:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526592 00000100:00100000:1.0:1790772381.222682:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1790772381.222689:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1877760796526592:12345-192.168.201.34@tcp:38: 00010000:00080000:1.0:1790772381.222720:0:5855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1790772381.222772:0:5855:0:(genops.c:1384:class_connect()) connect: client 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677, cookie 0xd3c7635991be14a2 00000004:00100000:1.0:1790772381.222803:0:5855:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790772381.222809:0:5855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1790772381.256919:0:5855:0:(import.c:65:import_set_state_nolock()) ffff9328bfb09800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772381.257004:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2353:x1877760796526592:12345-192.168.201.34@tcp:38: Request processed in 34312us (34535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772381.257015:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00010000:00010000:2.0:1790772381.451219:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772382.279038:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772382.279096:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772382.279211:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526848 00000100:00100000:3.0:1790772382.279228:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526848 00000100:00100000:3.0:1790772382.279360:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526720 00000100:00100000:3.0:1790772382.279365:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526720 00000100:00100000:3.0:1790772382.279389:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772382.279399:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:5582:x1877760796526848:12345-192.168.201.34@tcp:41: 00000004:00000024:3.0:1790772382.279450:0:5857:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790772382.279534:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:5582:x1877760796526848:12345-192.168.201.34@tcp:41: Request processed in 136us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772382.279546:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772382.279567:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1790772382.279574:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:0:x1877760796526720:12345-192.168.201.34@tcp:41: 00000004:00000024:3.0:1790772382.279584:0:5857:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790772382.279622:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:0:x1877760796526720:12345-192.168.201.34@tcp:41: Request processed in 49us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772382.279629:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00080000:0.0:1790772382.280100:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772382.288128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772382.288799:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796526976 00000100:00100000:1.0:1790772382.288817:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796526976 00000100:00100000:1.0:1790772382.288961:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1790772382.288974:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5582:x1877760796526976:12345-192.168.201.34@tcp:40: 00000100:00100000:1.0:1790772382.289110:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5582:x1877760796526976:12345-192.168.201.34@tcp:40: Request processed in 137us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772382.289120:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1790772382.295431:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772382.295485:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772382.295622:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527360 00000100:00100000:3.0:1790772382.295646:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527360 00000100:00100000:3.0:1790772382.295731:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1790772382.295743:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5582:x1877760796527360:12345-192.168.201.34@tcp:33: 00000100:00100000:0.0:1790772382.297298:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772382.297424:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527104 00000100:00100000:1.0:1790772382.297434:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527104 00000100:00100000:1.0:1790772382.297476:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1790772382.297484:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877760796527104:12345-192.168.201.34@tcp:8: 00010000:00080000:1.0:1790772382.297523:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1790772382.297585:0:6705:0:(genops.c:1384:class_connect()) connect: client 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677, cookie 0xd3c7635991be14a9 00002000:00100000:1.0:1790772382.297603:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677/ffff9328bfb0d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790772382.297655:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790772382.298153:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790772382.298197:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9328bfb0a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772382.298314:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2353:x1877760796527104:12345-192.168.201.34@tcp:8: Request processed in 829us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772382.298325:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1790772382.298588:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772382.299106:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527232 00000100:00100000:0.0:1790772382.299117:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527232 00000100:00100000:0.0:1790772382.299163:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1790772382.299173:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1877760796527232:12345-192.168.201.34@tcp:8: 00010000:00080000:0.0:1790772382.299210:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1790772382.299241:0:6706:0:(genops.c:1384:class_connect()) connect: client 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677, cookie 0xd3c7635991be14b0 00002000:00100000:0.0:1790772382.299255:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677/ffff93288f0a3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772382.299283:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790772382.302163:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790772382.302226:0:6706:0:(import.c:65:import_set_state_nolock()) ffff93288f0a1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772382.302352:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2353:x1877760796527232:12345-192.168.201.34@tcp:8: Request processed in 3177us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772382.302365:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772382.305815:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527488 00000100:00100000:2.0:1790772382.305839:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527488 00000100:00100000:2.0:1790772382.305974:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:2.0:1790772382.305989:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2356:x1877760796527488:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1790772382.306107:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2356:x1877760796527488:12345-192.168.201.34@tcp:400: Request processed in 122us (10619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772382.306116:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000004:00080000:1.0:1790772382.335012:0:5858:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39171us 00000004:00200000:2.0:1790772382.351651:0:5858:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790772382.351799:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5582:x1877760796527360:12345-192.168.201.34@tcp:33: Request processed in 56052us (56376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772382.351819:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00010000:00010000:2.0:1790772382.475974:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772382.619151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772382.619561:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527616 00000100:00100000:2.0:1790772382.619576:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527616 00000100:00100000:1.0:1790772382.619769:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1790772382.619784:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5622:x1877760796527616:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1790772382.619816:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772382.621409:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328813fcc00/0xd3c7635991be14b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50783 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772382.621523:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be14be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772382.621552:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be14be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772382.621570:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be14be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772382.621606:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790772382.621610:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772382.621630:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be14be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772382.621668:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328813fcc00/0xd3c7635991be14b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50783 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772382.621709:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be14be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50783 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772382.621718:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:1.0:1790772382.621721:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772382.622127:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dac00, rc 0) 00000100:00100000:1.0:1790772382.622217:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:5622:x1877760796527616:12345-192.168.201.34@tcp:101: Request processed in 2435us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772382.622226:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:2.0:1790772383.499870:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772383.948435:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813326208:0@lo:13: 00000100:00100000:0.0:1790772383.948511:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772383.948665:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326208 00000100:00100000:3.0:1790772383.948674:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326208 00000100:00100000:3.0:1790772383.948752:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772383.948762:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813326208:12345-0@lo:13: 00002000:00000024:3.0:1790772383.948785:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772383.948838:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813326208:12345-0@lo:13: Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772383.948845:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790772383.949070:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f91180 x1877760813326208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772383.949093:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813326208:0@lo:13: 00000100:00080000:0.0:1790772383.951965:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790772384.523058:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772384.795412:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772384.795665:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527744 00000100:00100000:3.0:1790772384.795675:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527744 00000100:00100000:3.0:1790772384.795752:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1790772384.795763:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:5675:x1877760796527744:12345-192.168.201.34@tcp:41: 00000004:00000024:3.0:1790772384.795808:0:5857:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790772384.795915:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:5675:x1877760796527744:12345-192.168.201.34@tcp:41: Request processed in 154us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772384.795922:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:0.0:1790772384.796002:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772384.800157:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772384.800619:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796527872 00000100:00100000:2.0:1790772384.800634:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796527872 00000100:00100000:2.0:1790772384.800740:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772384.800753:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5675:x1877760796527872:12345-192.168.201.34@tcp:13: 00002000:00000024:2.0:1790772384.800810:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772384.800939:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5675:x1877760796527872:12345-192.168.201.34@tcp:13: Request processed in 188us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772384.800948:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:0.0:1790772384.801212:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772384.817192:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772384.818628:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528000 00000100:00100000:0.0:1790772384.818647:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528000 00000100:00100000:0.0:1790772384.818755:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1790772384.818768:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5675:x1877760796528000:12345-192.168.201.34@tcp:13: 00002000:00000024:0.0:1790772384.818824:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772384.818958:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:5675:x1877760796528000:12345-192.168.201.34@tcp:13: Request processed in 191us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772384.818966:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00080000:2.0:1790772384.820117:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772385.483376:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813326592:0@lo:400: 00000100:00100000:0.0:1790772385.483476:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772385.483574:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772385.483580:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813326720:0@lo:400: 00000100:00100000:0.0:1790772385.483611:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772385.483663:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326592 00000100:00100000:0.0:1790772385.483675:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326592 00000100:00100000:0.0:1790772385.483743:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772385.483753:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813326592:12345-0@lo:400: 00000100:00100000:0.0:1790772385.483824:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813326592:12345-0@lo:400: Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772385.483830:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772385.483852:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326720 00000100:00100000:0.0:1790772385.483855:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326720 00000100:00100000:0.0:1790772385.483905:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772385.484206:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813326336:0@lo:400: 00000100:00100000:2.0:1790772385.484266:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772385.484305:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813326848:0@lo:400: 00000100:00100000:2.0:1790772385.484336:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772385.484360:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790772385.484366:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813326464:0@lo:400: 00000100:00100000:2.0:1790772385.484388:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772385.484409:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813326976:0@lo:400: 00000100:00100000:2.0:1790772385.484436:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772385.484467:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326848 00000100:00100000:2.0:1790772385.484471:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326848 00000100:00100000:2.0:1790772385.484494:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326464 00000100:00100000:2.0:1790772385.484497:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326464 00000100:00100000:2.0:1790772385.484509:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772385.484516:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813326848:12345-0@lo:400: 00000100:00100000:2.0:1790772385.484558:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813326848:12345-0@lo:400: Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772385.484565:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772385.484598:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772385.484604:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813326464:12345-0@lo:400: 00000100:00100000:2.0:1790772385.484635:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813326464:12345-0@lo:400: Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772385.484642:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772385.484686:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813326464:0@lo:400: 00000100:00100000:2.0:1790772385.484699:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813326848:0@lo:400: 00000100:00100000:0.0:1790772385.484837:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813326720:12345-0@lo:400: 00000100:00100000:0.0:1790772385.484988:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813326720:12345-0@lo:400: Request processed in 154us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772385.484995:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772385.485008:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326976 00000100:00100000:0.0:1790772385.485012:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326976 00000100:00100000:0.0:1790772385.485033:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772385.485039:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813326976:12345-0@lo:400: 00000100:00100000:0.0:1790772385.485072:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813326976:12345-0@lo:400: Request processed in 33us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772385.485079:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790772385.485098:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772385.485103:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772385.485107:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772385.485153:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888281180 x1877760813326720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772385.485167:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813326720:0@lo:400: 00000100:00100000:0.0:1790772385.485180:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813326592:0@lo:400: 00000100:00100000:0.0:1790772385.485229:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813326336 00000100:00100000:0.0:1790772385.485246:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813326336 00000100:00100000:0.0:1790772385.485275:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790772385.485282:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813326336:12345-0@lo:400: 00000100:00100000:0.0:1790772385.485315:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813326336:12345-0@lo:400: Request processed in 34us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772385.485321:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:2.0:1790772385.485509:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888283100 x1877760813326976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772385.485522:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813326976:0@lo:400: 00000100:00100000:2.0:1790772385.485531:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813326336:0@lo:400: 00010000:00010000:2.0:1790772385.549866:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772385.995651:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813327104:0@lo:13: 00000100:00100000:2.0:1790772385.995759:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772386.001319:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327104 00000100:00100000:0.0:1790772386.001340:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327104 00000100:00100000:0.0:1790772386.001417:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772386.001449:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813327104:12345-0@lo:13: 00002000:00000024:0.0:1790772386.001486:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772386.001607:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813327104:12345-0@lo:13: Request processed in 160us (5848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772386.001615:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790772386.001681:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888281180 x1877760813327104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772386.001708:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813327104:0@lo:13: 00000001:00100000:3.0:1790772386.071930:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000001:00100000:3.0:1790772386.554548:0:5878:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00010000:00010000:2.0:1790772386.571075:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790772386.609237:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000100:00100000:2.0:1790772387.443841:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772387.443924:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772387.443954:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772387.443982:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772387.444018:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528128 00000100:00100000:2.0:1790772387.444032:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528128 00000100:00100000:2.0:1790772387.444099:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:2.0:1790772387.444112:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796528128:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1790772387.444226:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796528128:12345-192.168.201.34@tcp:400: Request processed in 116us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772387.444247:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:2.0:1790772387.444317:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528384 00000100:00100000:2.0:1790772387.444322:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528384 00000100:00100000:2.0:1790772387.444364:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528512 00000100:00100000:2.0:1790772387.444368:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528512 00000100:00100000:2.0:1790772387.444386:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772387.444393:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796528384:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1790772387.444428:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796528384:12345-192.168.201.34@tcp:400: Request processed in 35us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772387.444435:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772387.444449:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1790772387.444456:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796528512:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1790772387.444481:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796528512:12345-192.168.201.34@tcp:400: Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772387.444487:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1790772387.444506:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528256 00000100:00100000:2.0:1790772387.444509:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528256 00000100:00100000:2.0:1790772387.444543:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1790772387.444549:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796528256:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1790772387.444739:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796528256:12345-192.168.201.34@tcp:400: Request processed in 188us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772387.444746:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00080000:2.0:1790772387.445667:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772387.445675:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772387.445677:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790772387.605145:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772387.977822:0:8311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790772388.619105:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772389.068023:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772389.068062:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813327232:0@lo:13: 00000100:00100000:2.0:1790772389.068164:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772389.068980:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327232 00000100:00100000:0.0:1790772389.068996:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327232 00000100:00100000:0.0:1790772389.069090:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772389.069104:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813327232:12345-0@lo:13: 00002000:00000024:0.0:1790772389.069144:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772389.069253:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813327232:12345-0@lo:13: Request processed in 153us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772389.069261:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790772389.069591:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772389.070770:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f93100 x1877760813327232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772389.070808:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813327232:0@lo:13: 00010000:00010000:2.0:1790772389.643060:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772390.606848:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813327488:0@lo:400: 00000100:00100000:0.0:1790772390.606848:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813327744:0@lo:400: 00000100:00100000:0.0:1790772390.606986:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772390.607077:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772390.607085:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813327616:0@lo:400: 00000100:00100000:0.0:1790772390.607118:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772390.607182:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327616 00000100:00100000:0.0:1790772390.607193:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327616 00000100:00100000:1.0:1790772390.607220:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772390.607256:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813328000:0@lo:400: 00000100:00100000:0.0:1790772390.607259:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327488 00000100:00100000:0.0:1790772390.607264:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327488 00000100:00100000:1.0:1790772390.607288:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772390.607316:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772390.607322:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813327360:0@lo:400: 00000100:00100000:2.0:1790772390.607472:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327744 00000100:00100000:2.0:1790772390.607478:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327744 00000100:00100000:2.0:1790772390.607507:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813328000 00000100:00100000:2.0:1790772390.607510:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813328000 00000100:00100000:2.0:1790772390.607530:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772390.607541:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813327744:12345-0@lo:400: 00000100:00100000:1.0:1790772390.607576:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772390.607616:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813327872:0@lo:400: 00000100:00100000:2.0:1790772390.607627:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813327744:12345-0@lo:400: Request processed in 86us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772390.607637:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772390.607663:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772390.607664:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772390.607674:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813328000:12345-0@lo:400: 00000100:00100000:1.0:1790772390.607704:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327872 00000100:00100000:1.0:1790772390.607710:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327872 00000100:00100000:2.0:1790772390.607718:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813328000:12345-0@lo:400: Request processed in 46us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772390.607726:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772390.607742:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790772390.607749:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772390.607751:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813327616:12345-0@lo:400: 00000100:00080000:2.0:1790772390.607757:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772390.607771:0:5857:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790772390.607782:0:5857:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790772390.607793:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813327616:12345-0@lo:400: Request processed in 42us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772390.607801:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772390.607817:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790772390.607825:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813327872:12345-0@lo:400: 00000100:00100000:2.0:1790772390.608009:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813327616:0@lo:400: 00000100:00100000:1.0:1790772390.608016:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813327872:12345-0@lo:400: Request processed in 189us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772390.608026:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1790772390.608032:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfdbfb80 x1877760813327744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772390.608046:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813327744:0@lo:400: 00000100:00100000:1.0:1790772390.608057:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813327360 00000100:00100000:1.0:1790772390.608063:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813327360 00000100:00100000:1.0:1790772390.608096:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790772390.608106:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813327360:12345-0@lo:400: 00000100:00100000:1.0:1790772390.608164:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813327360:12345-0@lo:400: Request processed in 61us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772390.608170:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790772390.608214:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813327360:0@lo:400: 00000100:00100000:1.0:1790772390.608225:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813327872:0@lo:400: 00010000:00080000:1.0:1790772390.608237:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cc000 x1877760813328000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772390.608247:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813328000:0@lo:400: 00000100:00100000:0.0:1790772390.608504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772390.608516:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813327488:12345-0@lo:400: 00000100:00100000:0.0:1790772390.608580:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813327488:12345-0@lo:400: Request processed in 67us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772390.608588:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772390.608931:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813327488:0@lo:400: 00010000:00010000:2.0:1790772390.669821:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772391.115145:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772391.115193:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813328128:0@lo:13: 00000100:00100000:3.0:1790772391.115293:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772391.115489:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813328128 00000100:00100000:0.0:1790772391.115576:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813328128 00000100:00100000:0.0:1790772391.115653:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772391.115665:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813328128:12345-0@lo:13: 00002000:00000024:0.0:1790772391.115714:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772391.115775:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813328128:12345-0@lo:13: Request processed in 112us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772391.115783:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790772391.115834:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888283100 x1877760813328128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772391.115856:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813328128:0@lo:13: 00010000:00010000:2.0:1790772391.691380:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772392.562749:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772392.562797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772392.562826:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772392.562860:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772392.562939:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528896 00000100:00100000:1.0:1790772392.562952:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528896 00000100:00100000:1.0:1790772392.563030:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529024 00000100:00100000:1.0:1790772392.563033:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529024 00000100:00100000:1.0:1790772392.563055:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772392.563066:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796528896:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1790772392.563180:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796528896:12345-192.168.201.34@tcp:400: Request processed in 115us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.563188:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772392.563209:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1790772392.563216:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796529024:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1790772392.563256:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796529024:12345-192.168.201.34@tcp:400: Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.563263:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1790772392.563284:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528640 00000100:00100000:1.0:1790772392.563287:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528640 00000100:00100000:1.0:1790772392.563315:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1790772392.563321:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2355:x1877760796528640:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1790772392.563349:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2355:x1877760796528640:12345-192.168.201.34@tcp:400: Request processed in 29us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.563356:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1790772392.563413:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796528768 00000100:00100000:1.0:1790772392.563435:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796528768 00000100:00100000:1.0:1790772392.563474:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1790772392.563481:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796528768:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1790772392.563517:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796528768:12345-192.168.201.34@tcp:400: Request processed in 37us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.563523:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00080000:1.0:1790772392.563551:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772392.563557:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772392.563558:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772392.732226:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790772392.831513:0:8460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0e486de0 20000000:00000080:0.0:1790772392.831541:0:8460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9328c11a2400 uarg=0000000000000000 20000000:01000000:0.0:1790772392.831594:0:8460:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790772392.831597:0:8460:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790772392.831601:0:8460:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790772392.831607:0:8460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790772392.831614:0:8460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790772392.831635:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790772392.831638:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790772392.831946:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790772392.831950:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790772392.842494:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1790772392.843607:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1790772392.843670:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1790772392.843704:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1790772392.843722:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790772392.843725:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790772392.846333:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1790772392.847180:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1790772392.847265:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1790772392.847298:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1790772392.847313:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790772392.847316:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790772392.848585:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1790772392.849285:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1790772392.849363:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1790772392.849395:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1790772392.849408:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790772392.849411:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790772392.860713:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790772392.861493:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790772392.861559:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790772392.861619:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1790772392.861648:0:8460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790772392.861675:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861698:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13bb expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861706:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861713:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be140f expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861720:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be141d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861727:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be142b expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861734:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1447 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861741:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1471 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861816:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861825:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861833:0:8460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861918:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.861938:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 9 pid: 5848 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.861957:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328256:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772392.862097:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862117:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 9 pid: 5849 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.862126:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328384:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772392.862161:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1471 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862168:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1471 expref: 18 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.862192:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328512:0@lo:104: 00000100:00100000:2.0:1790772392.862243:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.862305:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813328512 00000100:00100000:2.0:1790772392.862315:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813328512 00000100:00100000:2.0:1790772392.862367:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772392.862378:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813328512:12345-0@lo:104: 00010000:00010000:2.0:1790772392.862394:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862454:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772392.862461:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813328512:12345-0@lo:104: Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772392.862469:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790772392.862496:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772392.862502:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862510:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfc00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772392.862516:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862525:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772392.862533:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772392.862539:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772392.862583:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862590:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772392.862608:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862616:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be1471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862631:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.862633:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.862635:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.862656:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1447 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862664:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1447 expref: 18 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.862673:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328768:0@lo:104: 00000100:00100000:2.0:1790772392.862704:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.862733:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790772392.862744:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813328768 00000100:00100000:2.0:1790772392.862747:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813328768 00000100:00100000:2.0:1790772392.862766:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772392.862772:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf5ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813328768:12345-0@lo:104: 00010000:00010000:2.0:1790772392.862780:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862815:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772392.862827:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf5ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813328768:12345-0@lo:104: Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772392.862834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1790772392.862923:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be142b expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.862932:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be142b expref: 18 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.862941:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328896:0@lo:104: 00000100:00100000:2.0:1790772392.862965:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.862985:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813328896 00000100:00100000:2.0:1790772392.862989:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813328896 00000100:00100000:2.0:1790772392.863005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772392.863011:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813328896:12345-0@lo:104: 00010000:00010000:2.0:1790772392.863019:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863052:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790772392.863057:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813328896:12345-0@lo:104: Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772392.863063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1790772392.863077:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772392.863081:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863089:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881681c00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772392.863092:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863122:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772392.863130:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772392.863136:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772392.863151:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863157:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772392.863174:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863181:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881681c00/0xd3c7635991be1447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be144e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863199:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772392.863202:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863208:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881681e00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772392.863211:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863218:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772392.863224:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772392.863236:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772392.863249:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863255:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772392.863259:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881681e00/0xd3c7635991be142b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1432 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.863278:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.863280:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772392.863294:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813329152:0@lo:103: 00000100:00100000:2.0:1790772392.863326:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.863350:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772392.863356:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813329024:0@lo:103: 00000100:00100000:2.0:1790772392.863375:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.863401:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329152 00000100:00100000:2.0:1790772392.863405:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329152 00010000:00010000:2.0:1790772392.863422:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be142b expref: 19 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.863440:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329024 00000100:00100000:2.0:1790772392.863444:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329024 00010000:00010000:2.0:1790772392.863453:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1447 expref: 20 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.863479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772392.863485:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3318:x1877760813329152:12345-0@lo:103: 00010000:00010000:2.0:1790772392.863497:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772392.863503:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be142b expref: 20 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863512:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be142b expref: 20 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863530:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772392.863557:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3318:x1877760813329152:12345-0@lo:103: Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772392.863564:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772392.863577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772392.863583:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813329024:12345-0@lo:103: 00010000:00010000:2.0:1790772392.863591:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772392.863595:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1447 expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863603:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1447 expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863613:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772392.863632:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813329024:12345-0@lo:103: Request processed in 49us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772392.863638:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772392.863673:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813329024:0@lo:103: 00000100:00100000:2.0:1790772392.863690:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813329152:0@lo:103: 00010000:00010000:2.0:1790772392.863723:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be141d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863732:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be141d expref: 18 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.863741:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813329280:0@lo:104: 00000100:00100000:2.0:1790772392.863761:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.863780:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329280 00000100:00100000:2.0:1790772392.863783:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329280 00000100:00100000:2.0:1790772392.863799:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772392.863804:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813329280:12345-0@lo:104: 00010000:00010000:2.0:1790772392.863814:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863843:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772392.863848:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813329280:12345-0@lo:104: Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772392.863854:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1790772392.863866:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772392.863871:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863907:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881680c00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772392.863911:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863930:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772392.863936:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772392.863942:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772392.863957:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863963:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772392.863971:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863979:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881680c00/0xd3c7635991be141d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.863997:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.863999:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.864000:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772392.864021:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be140f expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772392.864029:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be140f expref: 18 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772392.864038:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813329536:0@lo:104: 00000100:00100000:2.0:1790772392.864061:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772392.864080:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329536 00000100:00100000:2.0:1790772392.864089:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329536 00000100:00100000:1.0:1790772392.864649:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772392.864661:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813329536:12345-0@lo:104: 00010000:00010000:1.0:1790772392.864673:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.864725:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772392.864731:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813329536:12345-0@lo:104: Request processed in 74us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.864738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772392.864837:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813329408:0@lo:103: 00000100:00100000:1.0:1790772392.864870:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.864918:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772392.864924:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813328640:0@lo:103: 00000100:00100000:1.0:1790772392.864946:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.864969:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329408 00000100:00100000:1.0:1790772392.864973:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329408 00010000:00010000:1.0:1790772392.864992:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be141d expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.865021:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813328640 00000100:00100000:1.0:1790772392.865025:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813328640 00010000:00010000:1.0:1790772392.865039:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1471 expref: 20 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.865051:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772392.865058:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3315:x1877760813329408:12345-0@lo:103: 00010000:00010000:1.0:1790772392.865067:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772392.865072:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be141d expref: 20 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865080:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be141d expref: 20 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865119:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772392.865150:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3315:x1877760813329408:12345-0@lo:103: Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.865157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772392.865172:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772392.865179:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813328640:12345-0@lo:103: 00010000:00010000:1.0:1790772392.865186:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772392.865190:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1471 expref: 19 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865198:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1471 expref: 19 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865206:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772392.865235:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813328640:12345-0@lo:103: Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.865241:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772392.865276:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813328640:0@lo:103: 00000100:00100000:1.0:1790772392.865285:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813329408:0@lo:103: 00010000:00010000:1.0:1790772392.865308:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772392.865314:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865321:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881681a00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772392.865325:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865334:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772392.865341:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772392.865346:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772392.865367:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865374:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772392.865388:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881681a00/0xd3c7635991be140f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1416 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865423:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.865425:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.865426:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772392.865432:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772392.865440:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813329664:0@lo:103: 00000100:00100000:1.0:1790772392.865464:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.865488:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329664 00000100:00100000:1.0:1790772392.865492:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329664 00010000:00010000:1.0:1790772392.865505:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be140f expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.865523:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772392.865528:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813329664:12345-0@lo:103: 00010000:00010000:1.0:1790772392.865537:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772392.865541:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be140f expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865549:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be140f expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865560:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772392.865583:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813329664:12345-0@lo:103: Request processed in 55us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.865589:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790772392.865612:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813329664:0@lo:103: 00010000:00010000:1.0:1790772392.865659:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.865713:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865730:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 18 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.865741:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813329792:0@lo:104: 00000100:00100000:1.0:1790772392.865765:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.865788:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329792 00000100:00100000:1.0:1790772392.865792:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329792 00000100:00100000:1.0:1790772392.865809:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772392.865815:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813329792:12345-0@lo:104: 00010000:00010000:1.0:1790772392.865824:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865857:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772392.865863:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813329792:12345-0@lo:104: Request processed in 49us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.865869:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1790772392.865919:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772392.865923:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865930:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518c00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772392.865933:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865940:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772392.865946:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772392.865959:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772392.865974:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.865980:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772392.865994:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866001:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881518c00/0xd3c7635991be13e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13ec expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866012:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.866014:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.866015:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772392.866024:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813329920:0@lo:103: 00000100:00100000:1.0:1790772392.866051:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.866080:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813329920 00000100:00100000:1.0:1790772392.866084:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813329920 00010000:00010000:1.0:1790772392.866097:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 19 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866128:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772392.866135:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813329920:12345-0@lo:103: 00010000:00010000:1.0:1790772392.866144:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772392.866148:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 19 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866155:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 19 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866173:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772392.866202:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813329920:12345-0@lo:103: Request processed in 67us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.866209:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772392.866238:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813329920:0@lo:103: 00010000:00010000:1.0:1790772392.866264:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be13bb expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866272:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be13bb expref: 18 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866281:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813330048:0@lo:104: 00000100:00100000:1.0:1790772392.866302:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.866322:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330048 00000100:00100000:1.0:1790772392.866325:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330048 00000100:00100000:1.0:1790772392.866341:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772392.866346:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813330048:12345-0@lo:104: 00010000:00010000:1.0:1790772392.866354:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866386:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772392.866390:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8460:x1877760813330048:12345-0@lo:104: Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.866397:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790772392.866410:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772392.866414:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866432:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fd600 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772392.866435:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866443:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772392.866450:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772392.866456:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772392.866472:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866478:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772392.866488:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866495:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fd600/0xd3c7635991be13bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13c2 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866510:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.866512:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772392.866514:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772392.866523:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813330176:0@lo:103: 00000100:00100000:1.0:1790772392.866551:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772392.866577:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330176 00000100:00100000:1.0:1790772392.866580:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330176 00010000:00010000:1.0:1790772392.866593:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be13bb expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772392.866626:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813330176:12345-0@lo:103: 00010000:00010000:1.0:1790772392.866634:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772392.866638:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be13bb expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866646:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be13bb expref: 19 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.866657:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772392.866683:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813330176:12345-0@lo:103: Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.866689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772392.866740:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813330176:0@lo:103: 00000100:00100000:1.0:1790772392.866758:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0b40 going to sleep for 11 seconds 00010000:00010000:1.0:1790772392.866773:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881519200/0xd3c7635991be1478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1471 expref: 18 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866784:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328512:0@lo:104: 00010000:00010000:1.0:1790772392.866795:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fc400/0xd3c7635991be144e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1447 expref: 17 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866804:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328768:0@lo:104: 00010000:00010000:1.0:1790772392.866814:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880031e00/0xd3c7635991be1432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be142b expref: 16 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866825:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328896:0@lo:104: 00010000:00010000:1.0:1790772392.866846:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030200/0xd3c7635991be1424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be141d expref: 15 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866855:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813329280:0@lo:104: 00010000:00010000:1.0:1790772392.866866:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fda00/0xd3c7635991be1416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be140f expref: 14 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866911:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813329536:0@lo:104: 00010000:00010000:1.0:1790772392.866922:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fc200/0xd3c7635991be13ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be13e5 expref: 13 pid: 5849 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866930:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813329792:0@lo:104: 00010000:00010000:1.0:1790772392.866938:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881680800/0xd3c7635991be13c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be13bb expref: 12 pid: 5850 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.866952:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813330048:0@lo:104: 00000100:00100000:1.0:1790772392.872771:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772392.872823:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772392.872866:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529280 00000100:00100000:1.0:1790772392.872908:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529280 00010000:00010000:1.0:1790772392.872963:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 10 pid: 5849 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.873002:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529152 00000100:00100000:1.0:1790772392.873005:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529152 00010000:00010000:1.0:1790772392.873018:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 11 pid: 5848 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772392.873033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1790772392.873065:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2354:x1877760796529280:12345-192.168.201.34@tcp:103: 00000100:00100000:0.0:1790772392.873204:0:5842:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790772392.873218:0:5842:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790772392.873453:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1790772392.873463:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2355:x1877760796529152:12345-192.168.201.34@tcp:103: 00010000:00010000:0.0:1790772392.873477:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772392.873485:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 11 pid: 5848 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772392.873501:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 11 pid: 5848 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772392.873529:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772392.873605:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2355:x1877760796529152:12345-192.168.201.34@tcp:103: Request processed in 143us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772392.873614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:3.0:1790772392.874557:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881518800/0xd3c7635991be148d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50728 expref: 10 pid: 5848 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772392.874578:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328256:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772392.874593:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1877760813328384:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772392.874649:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.874901:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772392.874912:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 9 pid: 5849 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.874927:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 9 pid: 5849 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.874945:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881681200/0xd3c7635991be1486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50721 expref: 9 pid: 5849 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.874969:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.874979:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875000:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875009:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875017:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875025:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875032:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519e00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772392.875037:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875055:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875075:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772392.875167:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772392.876567:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:2354:x1877760796529280:12345-192.168.201.34@tcp:103: Request processed in 2165us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772392.876586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00010000:00010000:3.0:1790772392.880775:0:8460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772392.880799:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772392.880807:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881519e00/0xd3c7635991be14c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772393.742749:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790772394.188472:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790772394.188483:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9328bb7d8800 from 39 10000000:01000000:0.0:1790772394.188491:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790772394.188557:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.188568:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.188578:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.188603:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813330304:0@lo:101: 00000100:00100000:0.0:1790772394.188683:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.188749:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.189308:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330304 00000100:00100000:1.0:1790772394.189319:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330304 00000100:00100000:1.0:1790772394.189391:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790772394.189402:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+12:5852:x1877760813330304:12345-0@lo:101: 00010000:00010000:1.0:1790772394.189433:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772394.189451:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4dbc00/0xd3c7635991be14d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be14cc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.189774:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4dbc00/0xd3c7635991be14d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be14cc expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.189787:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4dbc00/0xd3c7635991be14d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be14cc expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.189797:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dbc00, rc 0) 00000100:00100000:1.0:1790772394.189871:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813330304:12345-0@lo:101: Request processed in 471us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.189926:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790772394.190037:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813330304:0@lo:101: 00010000:00010000:0.0:1790772394.190067:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.190077:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.190162:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813330432:0@lo:501: 00000100:00100000:0.0:1790772394.190194:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.190229:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.190289:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330432 00000100:00100000:1.0:1790772394.190295:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330432 00000100:00100000:1.0:1790772394.190409:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790772394.190432:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813330432:12345-0@lo:501: 00000100:00100000:1.0:1790772394.190871:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813330432:12345-0@lo:501: Request processed in 439us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.190911:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790772394.190978:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813330432:0@lo:501: 00000100:00100000:2.0:1790772394.191018:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813330560:0@lo:503: 00000100:00100000:2.0:1790772394.191067:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.191409:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772394.191435:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813330688:0@lo:13: 00000100:00100000:3.0:1790772394.191678:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.191728:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330688 00000100:00100000:3.0:1790772394.191734:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330688 00000100:00100000:3.0:1790772394.191789:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772394.191797:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813330688:12345-0@lo:13: 00002000:00000024:3.0:1790772394.191834:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772394.191897:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813330688:12345-0@lo:13: Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.191904:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790772394.191945:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c4380 x1877760813330688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772394.191967:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813330688:0@lo:13: 00000100:00080000:3.0:1790772394.192022:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772394.192765:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330560 00000100:00100000:0.0:1790772394.192772:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330560 00000100:00100000:2.0:1790772394.192793:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf60a600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.192833:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790772394.192844:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813330560:12345-0@lo:503: 00000100:00100000:1.0:1790772394.193133:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813330560:12345-0@lo:503: Request processed in 291us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.193142:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790772394.193242:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813330560:0@lo:503: 00000100:00100000:2.0:1790772394.193554:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8477:1877760813330816:0@lo:502: 00000100:00100000:2.0:1790772394.193602:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.195826:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf60a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790772394.195991:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330816 00000100:00100000:3.0:1790772394.196005:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330816 00000100:00100000:3.0:1790772394.196207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790772394.196236:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:8477:x1877760813330816:12345-0@lo:502: 00000100:00100000:3.0:1790772394.196837:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:8477:x1877760813330816:12345-0@lo:502: Request processed in 602us (3232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.196847:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790772394.196952:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8477:1877760813330816:0@lo:502: 00000100:00100000:0.0:1790772394.197040:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8477:1877760813330944:0@lo:502: 00000100:00100000:0.0:1790772394.197102:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.201802:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.205216:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813330944 00000100:00100000:2.0:1790772394.205236:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813330944 00000100:00100000:3.0:1790772394.205378:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790772394.205398:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:8477:x1877760813330944:12345-0@lo:502: 00000100:00100000:3.0:1790772394.206712:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+13:8477:x1877760813330944:12345-0@lo:502: Request processed in 1311us (9601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.206727:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790772394.206781:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8477:1877760813330944:0@lo:502: 00000040:00080000:0.0:1790772394.206833:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790772394.207280:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790772394.207312:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772394.207329:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.207343:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772394.207355:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790772394.207358:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790772394.207362:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790772394.207407:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.207417:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.207963:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772394.208008:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331072:0@lo:101: 00000100:00100000:2.0:1790772394.208076:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.208137:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328988e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.208325:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331072 00000100:00100000:1.0:1790772394.208335:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331072 00000100:00100000:1.0:1790772394.208382:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790772394.208396:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+13:5852:x1877760813331072:12345-0@lo:101: 00010000:00010000:1.0:1790772394.208411:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772394.208427:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4dbe00/0xd3c7635991be14e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be14da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.208451:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4dbe00/0xd3c7635991be14e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be14da expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.208463:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4dbe00/0xd3c7635991be14e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be14da expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.208494:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dbe00, rc 0) 00000100:00100000:1.0:1790772394.208543:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813331072:12345-0@lo:101: Request processed in 154us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.208549:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790772394.208604:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331072:0@lo:101: 00010000:00010000:2.0:1790772394.208623:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.208633:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772394.208697:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331200:0@lo:501: 00000100:00100000:2.0:1790772394.208726:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.208748:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328988e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772394.208803:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331200 00000100:00100000:3.0:1790772394.208808:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331200 00000100:00100000:3.0:1790772394.208840:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790772394.208849:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813331200:12345-0@lo:501: 00000100:00100000:3.0:1790772394.209678:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813331200:12345-0@lo:501: Request processed in 827us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.209688:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790772394.215674:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331200:0@lo:501: 00000100:00100000:2.0:1790772394.215774:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331328:0@lo:503: 00000100:00100000:2.0:1790772394.216551:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.216688:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328988e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.225925:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331328 00000100:00100000:1.0:1790772394.225957:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331328 00000100:00100000:1.0:1790772394.226060:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790772394.226075:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813331328:12345-0@lo:503: 00000100:00100000:1.0:1790772394.226653:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813331328:12345-0@lo:503: Request processed in 581us (10103us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.226664:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790772394.226723:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331328:0@lo:503: 00000100:00100000:2.0:1790772394.231148:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8478:1877760813331456:0@lo:502: 00000100:00100000:2.0:1790772394.231270:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.231339:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328988e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.231396:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331456 00000100:00100000:1.0:1790772394.231411:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331456 00000100:00100000:1.0:1790772394.231501:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790772394.231514:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8478:x1877760813331456:12345-0@lo:502: 00000100:00100000:1.0:1790772394.231843:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8478:x1877760813331456:12345-0@lo:502: Request processed in 331us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.231852:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790772394.233092:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8478:1877760813331456:0@lo:502: 00000020:01000000:3.0:1790772394.233142:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772394.233157:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772394.233160:0:8478:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790772394.233168:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790772394.233211:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8478:1877760813331584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.233287:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.233405:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.237858:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331584 00000100:00100000:2.0:1790772394.237915:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331584 00000100:00100000:2.0:1790772394.237997:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790772394.238010:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8478:x1877760813331584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772394.238788:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:8478:x1877760813331584:12345-0@lo:502:llog_process_th.0 Request processed in 777us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.238808:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790772394.243215:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8478:1877760813331584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772394.243289:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772394.243318:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772394.243321:0:8478:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790772394.243329:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1790772394.243659:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1790772394.243686:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790772394.243702:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.243717:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772394.243731:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790772394.243742:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9328ba5e9800 from 39 10000000:01000000:0.0:1790772394.243746:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790772394.243793:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.243802:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.243814:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.243841:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.243970:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.244018:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.244058:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331712 00000100:00100000:1.0:1790772394.244068:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331712 00000100:00100000:1.0:1790772394.244143:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790772394.244154:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+14:5852:x1877760813331712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772394.244172:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772394.244188:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be14ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be14e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.244232:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be14ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be14e8 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.244262:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be14ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be14e8 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.244272:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dba00, rc 0) 00000100:00100000:1.0:1790772394.244332:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813331712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.244340:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790772394.244655:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772394.244671:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.244681:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772394.244741:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.248136:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.248213:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.248388:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331840 00000100:00100000:1.0:1790772394.248401:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331840 00000100:00100000:1.0:1790772394.248548:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790772394.248560:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813331840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772394.249403:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813331840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 841us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.249414:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790772394.249650:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.249717:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.249778:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.249823:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772394.249842:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813331968 00000100:00100000:3.0:1790772394.249849:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813331968 00000100:00100000:3.0:1790772394.249911:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790772394.249920:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813331968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.250128:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813331968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.250136:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790772394.250172:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813331968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.257561:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8479:1877760813332096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.257732:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.257804:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772394.257869:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332096 00000100:00100000:0.0:1790772394.257898:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332096 00000100:00100000:0.0:1790772394.257966:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790772394.257977:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8479:x1877760813332096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772394.258555:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8479:x1877760813332096:12345-0@lo:502:llog_process_th.0 Request processed in 578us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772394.258568:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790772394.258592:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8479:1877760813332096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.258735:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8479:1877760813332224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.258776:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.258870:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.258919:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332224 00000100:00100000:1.0:1790772394.258926:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332224 00000100:00100000:1.0:1790772394.258960:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790772394.258969:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8479:x1877760813332224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772394.259144:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:8479:x1877760813332224:12345-0@lo:502:llog_process_th.0 Request processed in 176us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.259153:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790772394.259171:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8479:1877760813332224:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790772394.259206:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790772394.260060:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790772394.260097:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772394.260110:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.260134:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772394.260146:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790772394.260159:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1790772394.260163:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790772394.260199:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.260208:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.260219:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.260240:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.260291:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.260343:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.260425:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332352 00000100:00100000:1.0:1790772394.260442:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332352 00000100:00100000:1.0:1790772394.260490:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790772394.260498:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+15:5852:x1877760813332352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772394.260512:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772394.260527:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da600/0xd3c7635991be14fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be14f6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.260554:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da600/0xd3c7635991be14fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be14f6 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.260566:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da600/0xd3c7635991be14fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be14f6 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.260577:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da600, rc 0) 00000100:00100000:1.0:1790772394.260627:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813332352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.260634:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790772394.260923:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772394.260942:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.260953:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772394.261119:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba716300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772394.261153:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772394.261260:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b93130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.261703:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332480 00000100:00100000:2.0:1790772394.261710:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332480 00000100:00100000:1.0:1790772394.262145:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790772394.262156:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813332480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772394.262544:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813332480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.262554:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790772394.262636:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba716300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.262697:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.262759:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.264166:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772394.264421:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332608 00000100:00100000:0.0:1790772394.264499:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332608 00000100:00100000:0.0:1790772394.264558:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790772394.264569:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813332608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.265052:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813332608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 482us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772394.265062:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790772394.265551:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.266229:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8480:1877760813332736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.266325:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.266369:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.266544:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332736 00000100:00100000:1.0:1790772394.266552:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332736 00000100:00100000:1.0:1790772394.266606:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790772394.266616:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8480:x1877760813332736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772394.266917:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8480:x1877760813332736:12345-0@lo:502:llog_process_th.0 Request processed in 302us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.266926:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790772394.267265:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8480:1877760813332736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772394.267309:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772394.267322:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772394.267324:0:8480:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790772394.267332:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790772394.267366:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8480:1877760813332864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772394.267410:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.267456:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.267756:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332864 00000100:00100000:1.0:1790772394.267764:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332864 00000100:00100000:1.0:1790772394.267807:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790772394.267816:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8480:x1877760813332864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772394.268033:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:8480:x1877760813332864:12345-0@lo:502:llog_process_th.0 Request processed in 217us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.268042:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790772394.268627:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8480:1877760813332864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772394.268660:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772394.268667:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772394.268669:0:8480:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790772394.268674:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790772394.268904:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790772394.268933:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790772394.268946:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.268959:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772394.268969:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790772394.268972:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff932891b62000 from 39 10000000:01000000:1.0:1790772394.268976:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790772394.269010:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.269018:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.269027:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772394.269057:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772394.269119:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772394.269156:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772394.269319:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813332992 00000100:00100000:3.0:1790772394.269327:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813332992 00000100:00100000:3.0:1790772394.269372:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790772394.269380:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813332992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772394.269393:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772394.269409:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be150b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1504 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.269541:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be150b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1504 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.269553:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be150b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1504 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.269563:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8800, rc 0) 00000100:00100000:3.0:1790772394.269616:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813332992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.269624:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790772394.269700:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813332992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772394.269717:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.269727:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.269791:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.269821:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.269848:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772394.269999:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333120 00000100:00100000:3.0:1790772394.270004:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333120 00000100:00100000:3.0:1790772394.270026:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790772394.270032:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813333120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.270346:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813333120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.270354:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790772394.270425:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.270469:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.270510:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.270541:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772394.270563:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333248 00000100:00100000:0.0:1790772394.270567:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333248 00000100:00100000:0.0:1790772394.270587:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790772394.270593:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813333248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.270755:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813333248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772394.270762:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790772394.270799:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.271592:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8481:1877760813333376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772394.271646:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.271718:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772394.271753:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333376 00000100:00100000:3.0:1790772394.271760:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333376 00000100:00100000:3.0:1790772394.271825:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790772394.271835:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8481:x1877760813333376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772394.272783:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8481:x1877760813333376:12345-0@lo:502:llog_process_th.0 Request processed in 945us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.272794:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790772394.272945:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8481:1877760813333376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.273015:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8481:1877760813333504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772394.273068:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772394.273287:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9313540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772394.273384:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333504 00000100:00100000:0.0:1790772394.273391:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333504 00000100:00100000:1.0:1790772394.273622:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790772394.273633:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8481:x1877760813333504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772394.274045:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8481:x1877760813333504:12345-0@lo:502:llog_process_th.0 Request processed in 414us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.274053:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790772394.274172:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8481:1877760813333504:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790772394.274203:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790772394.274519:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790772394.274548:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772394.274561:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.274575:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772394.274586:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790772394.274589:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790772394.274593:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790772394.274630:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.274640:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.274661:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.274681:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.274723:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.274803:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.274839:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333632 00000100:00100000:1.0:1790772394.274845:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333632 00000100:00100000:1.0:1790772394.275137:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790772394.275147:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813333632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772394.275161:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772394.275176:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da400/0xd3c7635991be1519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1512 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.275205:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da400/0xd3c7635991be1519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1512 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.275217:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da400/0xd3c7635991be1519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1512 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.275227:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da400, rc 0) 00000100:00100000:1.0:1790772394.275353:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813333632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772394.275359:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790772394.275421:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772394.275446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.275456:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.275510:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.275537:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.275677:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.275748:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333760 00000100:00100000:2.0:1790772394.275754:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333760 00000100:00100000:2.0:1790772394.275782:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790772394.275789:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813333760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772394.276133:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813333760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.276140:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790772394.276319:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.276353:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.276396:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.276409:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.276524:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813333888 00000100:00100000:2.0:1790772394.276529:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813333888 00000100:00100000:2.0:1790772394.276548:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790772394.276555:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813333888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772394.276723:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813333888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.276730:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790772394.276803:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813333888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.277295:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8482:1877760813334016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772394.277335:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.277372:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.277496:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334016 00000100:00100000:2.0:1790772394.277502:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334016 00000100:00100000:2.0:1790772394.277523:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790772394.277530:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8482:x1877760813334016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772394.277725:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8482:x1877760813334016:12345-0@lo:502:llog_process_th.0 Request processed in 195us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.277743:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790772394.277820:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8482:1877760813334016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772394.277845:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772394.277856:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772394.277859:0:8482:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790772394.277955:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790772394.277980:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8482:1877760813334144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772394.278014:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772394.278036:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772394.278095:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334144 00000100:00100000:2.0:1790772394.278100:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334144 00000100:00100000:2.0:1790772394.278118:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790772394.278124:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8482:x1877760813334144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772394.278256:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8482:x1877760813334144:12345-0@lo:502:llog_process_th.0 Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.278263:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790772394.278333:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8482:1877760813334144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772394.278350:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772394.278355:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772394.278356:0:8482:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790772394.278360:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790772394.278607:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1790772394.278627:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790772394.278639:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.278652:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772394.278663:0:5852:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790772394.278666:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff932894b719c0 from 1 10000000:01000000:2.0:1790772394.278670:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790772394.278700:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.278710:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.278720:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772394.278736:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813334272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772394.278776:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.278840:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772394.279136:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334272 00000100:00100000:1.0:1790772394.279143:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334272 00000100:00100000:0.0:1790772394.279202:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790772394.279212:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813334272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772394.279223:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772394.279238:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12bf800/0xd3c7635991be1527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1520 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.279265:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12bf800/0xd3c7635991be1527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1520 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.279277:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12bf800/0xd3c7635991be1527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1520 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772394.279286:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bf800, rc 0) 00000100:00100000:0.0:1790772394.279402:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813334272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772394.279419:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790772394.279616:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813334272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772394.279631:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.279641:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772394.279694:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813334400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772394.279721:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772394.279779:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772394.279816:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334400 00000100:00100000:0.0:1790772394.279820:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334400 00000100:00100000:0.0:1790772394.280075:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790772394.280096:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813334400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772394.280383:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813334400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (659us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772394.280391:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790772394.280466:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813334400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1790772394.280494:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790772394.280503:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772394.280513:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772394.740659:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772394.740924:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529408 00000100:00100000:3.0:1790772394.740939:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529408 00000100:00100000:3.0:1790772394.741014:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:3.0:1790772394.741025:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:5597:x1877760796529408:12345-192.168.201.34@tcp:101: 00010000:00010000:3.0:1790772394.741049:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772394.741088:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9000/0xd3c7635991be152e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5078a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.741130:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9000/0xd3c7635991be152e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5078a expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.741143:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9000/0xd3c7635991be152e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5078a expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772394.741153:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9000, rc 0) 00000100:00100000:3.0:1790772394.741235:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796529408:12345-192.168.201.34@tcp:101: Request processed in 211us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.741243:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:1.0:1790772394.746327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772394.746850:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529536 00000100:00100000:0.0:1790772394.746958:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529536 00000100:00100000:0.0:1790772394.747104:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:0.0:1790772394.747128:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796529536:12345-192.168.201.34@tcp:501: 00000100:00100000:0.0:1790772394.747552:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796529536:12345-192.168.201.34@tcp:501: Request processed in 436us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772394.747562:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:1.0:1790772394.754006:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772394.756595:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529664 00000100:00100000:3.0:1790772394.756617:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529664 00000100:00100000:3.0:1790772394.756715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:3.0:1790772394.756728:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796529664:12345-192.168.201.34@tcp:503: 00000100:00100000:3.0:1790772394.758051:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796529664:12345-192.168.201.34@tcp:503: Request processed in 1316us (4048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.758067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:1.0:1790772394.761366:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772394.761759:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529792 00000100:00100000:3.0:1790772394.761776:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529792 00000100:00100000:3.0:1790772394.761852:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:3.0:1790772394.761904:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:6069:x1877760796529792:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1790772394.762293:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:6069:x1877760796529792:12345-192.168.201.34@tcp:502: Request processed in 421us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772394.762304:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 167 00010000:00010000:1.0:1790772394.763046:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772394.771554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772394.771804:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796529920 00000100:00100000:0.0:1790772394.771819:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796529920 00000100:00100000:0.0:1790772394.771928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:0.0:1790772394.771940:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:6069:x1877760796529920:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772394.772355:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:6069:x1877760796529920:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 414us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772394.772366:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:0.0:1790772394.780105:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772394.784664:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530048 00000100:00100000:1.0:1790772394.784687:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530048 00000100:00100000:1.0:1790772394.784791:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:1.0:1790772394.784803:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796530048:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772394.784826:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772394.784851:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da000/0xd3c7635991be1535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50791 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.785096:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da000/0xd3c7635991be1535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50791 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.785110:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da000/0xd3c7635991be1535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50791 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772394.785184:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da000, rc 0) 00000100:00100000:2.0:1790772394.785572:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530048:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 768us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772394.785583:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:1.0:1790772394.791248:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772394.791391:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530176 00000100:00100000:3.0:1790772394.791403:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530176 00000100:00100000:3.0:1790772394.791479:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:3.0:1790772394.791491:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530176:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772394.792228:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530176:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 736us (991us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772394.792240:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:3.0:1790772395.737919:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813334528:0@lo:400:kworker.0 00000100:00100000:3.0:1790772395.738014:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772395.738153:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334528 00000100:00100000:1.0:1790772395.738164:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334528 00000100:00100000:1.0:1790772395.738236:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790772395.738246:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813334528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.740524:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813334656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.740638:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772395.740717:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334656 00000100:00100000:0.0:1790772395.740728:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334656 00000100:00100000:0.0:1790772395.740785:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772395.740794:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813334656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.740861:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813334656:12345-0@lo:400:kworker.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772395.740869:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772395.740962:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813334656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.741008:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813334784:0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.741037:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772395.741082:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334784 00000100:00100000:0.0:1790772395.741086:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334784 00000100:00100000:0.0:1790772395.741125:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772395.741132:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813334784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.741170:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813334784:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772395.741177:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790772395.741193:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772395.741295:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813334784:0@lo:400:kworker.0 00000100:00100000:1.0:1790772395.746186:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813334528:12345-0@lo:400:kworker.0 Request processed in 7926us (8156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772395.746588:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790772395.747638:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813334528:0@lo:400:kworker.0 00000100:00100000:3.0:1790772395.747815:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772395.747832:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813334912:0@lo:400:kworker.0 00000100:00100000:3.0:1790772395.747947:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772395.748095:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813334912 00000100:00100000:2.0:1790772395.748103:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813334912 00000100:00100000:2.0:1790772395.748169:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772395.748181:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813334912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772395.748412:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813334912:12345-0@lo:400:kworker.0 Request processed in 233us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772395.748421:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790772395.748465:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb01f80 x1877760813334912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772395.748479:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813334912:0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.750535:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813335168:0@lo:400:kworker.0 00000100:00100000:0.0:1790772395.750622:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772395.750738:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772395.750755:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813335040:0@lo:400:kworker.0 00000100:00100000:3.0:1790772395.750793:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772395.750987:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335040 00000100:00100000:3.0:1790772395.750998:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335040 00000100:00100000:3.0:1790772395.751086:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772395.751096:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813335040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772395.751162:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813335040:12345-0@lo:400:kworker.0 Request processed in 67us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772395.751170:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772395.751197:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335168 00000100:00100000:3.0:1790772395.751201:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335168 00000100:00100000:3.0:1790772395.751351:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772395.751359:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813335168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772395.751394:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813335168:12345-0@lo:400:kworker.0 Request processed in 37us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772395.751401:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772395.751445:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813335040:0@lo:400:kworker.0 00010000:00080000:0.0:1790772395.751528:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb00000 x1877760813335168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772395.751540:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813335168:0@lo:400:kworker.0 00000100:00080000:0.0:1790772395.751568:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772395.751574:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790772395.790086:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790772395.984091:0:8519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5d2272d0 20000000:00000080:1.0:1790772395.984182:0:8519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9328b99fb400 uarg=0000000000000000 20000000:01000000:1.0:1790772395.984232:0:8519:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790772395.984240:0:8519:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790772395.984246:0:8519:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790772395.985341:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1790772395.985517:0:8519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790772395.992690:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790772395.994196:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790772395.994322:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790772395.994341:0:8519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790772395.994366:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994388:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be12aa expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994394:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be130c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994399:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994417:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994425:0:8519:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994474:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994501:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 9 pid: 5848 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772395.994517:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335296:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772395.994631:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994637:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 18 pid: 5850 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772395.994643:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba716a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335424:0@lo:104: 00000100:00100000:1.0:1790772395.994682:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772395.994725:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be130c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994733:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be130c expref: 18 pid: 5848 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772395.994741:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335552:0@lo:104: 00000100:00100000:1.0:1790772395.994766:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772395.994792:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be12aa expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.994801:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be12aa expref: 18 pid: 5849 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772395.994821:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335680:0@lo:104: 00000100:00100000:1.0:1790772395.994845:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfafe780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772395.995005:0:5838:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790772395.995045:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772395.995075:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335424 00000100:00100000:3.0:1790772395.995083:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335424 00000100:00100000:3.0:1790772395.995142:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335552 00000100:00100000:3.0:1790772395.995145:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335552 00000100:00100000:3.0:1790772395.995161:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335680 00000100:00100000:3.0:1790772395.995164:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335680 00000100:00100000:3.0:1790772395.995183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772395.995194:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:8519:x1877760813335424:12345-0@lo:104: 00010000:00010000:3.0:1790772395.995210:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772395.995287:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772395.995294:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:8519:x1877760813335424:12345-0@lo:104: Request processed in 103us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772395.995309:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1790772395.995329:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1790772395.995335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1790772395.995339:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772395.995344:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+4:8519:x1877760813335552:12345-0@lo:104: 00010000:00010000:2.0:1790772395.995350:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030800 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772395.995355:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772395.995356:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772395.995369:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772395.995376:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772395.995380:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790772395.995407:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772395.995412:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+4:8519:x1877760813335552:12345-0@lo:104: Request processed in 72us (645us total) trans 0 rc 0/0 00010000:00010000:2.0:1790772395.995413:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772395.995420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1790772395.995428:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772395.995455:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772395.995462:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be13d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be13de expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772395.995463:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790772395.995468:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8519:x1877760813335680:12345-0@lo:104: 00010000:00010000:3.0:1790772395.995476:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772395.995491:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772395.995496:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772395.995501:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1790772395.995503:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fc000 already unused, calling callback (ffffffffc1b4ec20) 00000100:00100000:3.0:1790772395.995507:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:8519:x1877760813335680:12345-0@lo:104: Request processed in 38us (463us total) trans 0 rc 0/0 10000000:00010000:2.0:1790772395.995510:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772395.995512:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1790772395.995523:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772395.995526:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1790772395.995534:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772395.995540:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1790772395.995546:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813335808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772395.995560:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772395.995568:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790772395.995572:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772395.995593:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772395.995599:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813335936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772395.995603:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fc000/0xd3c7635991be130c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1313 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772395.995618:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772395.995618:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772395.995622:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772395.995626:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772395.996169:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba716a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335424:0@lo:104: 00000100:00100000:1.0:1790772395.996179:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335552:0@lo:104: 00000100:00100000:1.0:1790772395.996186:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335680:0@lo:104: 00000100:00100000:0.0:1790772395.996536:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335808 00000100:00100000:0.0:1790772395.996542:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335808 00010000:00010000:0.0:1790772395.996569:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 19 pid: 5850 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772395.996608:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813335936 00000100:00100000:0.0:1790772395.996611:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813335936 00010000:00010000:0.0:1790772395.996619:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be130c expref: 20 pid: 5848 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772395.996630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790772395.996635:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3318:x1877760813335808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772395.996646:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772395.996651:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 20 pid: 5850 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772395.996657:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 20 pid: 5850 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772395.996672:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fd400/0xd3c7635991be13de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be13d7 expref: 20 pid: 5850 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772395.996683:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772395.996734:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813335808:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772395.996741:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790772395.996758:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772395.996773:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3315:x1877760813335936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772395.996780:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772395.996783:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be130c expref: 18 pid: 5848 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772395.996790:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be130c expref: 18 pid: 5848 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772395.996800:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328813fc800/0xd3c7635991be1313 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be130c expref: 18 pid: 5848 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772395.996808:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772395.996849:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3315:x1877760813335936:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772395.996855:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772395.996906:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813335936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772395.996928:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813335808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772395.997423:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772395.997432:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772395.997435:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772395.997497:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997507:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fde00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772395.997511:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997521:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772395.997529:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772395.997535:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772395.997595:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997602:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772395.997629:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997636:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fde00/0xd3c7635991be12aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be12b1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997652:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772395.997654:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772395.997655:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772395.997693:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772395.997708:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813336064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772395.997754:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772395.997830:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336064 00000100:00100000:1.0:1790772395.997836:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336064 00010000:00010000:1.0:1790772395.997854:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be12aa expref: 17 pid: 5849 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772395.997903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772395.997912:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3315:x1877760813336064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772395.997923:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772395.997928:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be12aa expref: 17 pid: 5849 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997938:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be12aa expref: 17 pid: 5849 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997950:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881681600/0xd3c7635991be12b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be12aa expref: 17 pid: 5849 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772395.997966:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772395.998011:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3315:x1877760813336064:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772395.998017:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790772395.998182:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813336064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772395.999488:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1877760813335296:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772395.999525:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772396.004527:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772396.004645:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530304 00000100:00100000:1.0:1790772396.004660:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530304 00010000:00010000:1.0:1790772396.004711:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 10 pid: 5848 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772396.004760:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1790772396.004771:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2355:x1877760796530304:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772396.004791:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772396.004815:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 10 pid: 5848 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004830:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 10 pid: 5848 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004853:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881519600/0xd3c7635991be149b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50759 expref: 10 pid: 5848 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004935:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004946:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004966:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004975:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004983:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004991:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.004999:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772396.005005:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.005016:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.005042:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772396.005067:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772396.005081:0:8519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772396.005094:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772396.005101:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4da200/0xd3c7635991be153c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772396.005159:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:2355:x1877760796530304:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 389us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772396.005168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1790772396.235299:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772396.239096:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772396.239203:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772396.239343:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336192 00000100:00100000:3.0:1790772396.239364:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336192 00000100:00100000:3.0:1790772396.239437:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772396.239608:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813336192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772396.239666:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772396.239738:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813336192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 291us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772396.239747:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790772396.240399:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb01500 x1877760813336192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772396.240513:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772396.532712:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772396.534561:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530432 00000100:00100000:2.0:1790772396.534581:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530432 00000100:00100000:2.0:1790772396.534674:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:2.0:1790772396.534687:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:5597:x1877760796530432:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772396.534711:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772396.534739:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50798 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772396.534794:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772396.534807:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772396.534819:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518a00, rc 0) 00000100:00100000:2.0:1790772396.534951:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530432:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 266us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772396.534960:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:1.0:1790772396.549025:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772396.550959:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530560 00000100:00100000:2.0:1790772396.550982:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530560 00000100:00100000:2.0:1790772396.551093:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:2.0:1790772396.551106:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530560:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772396.553099:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530560:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 1982us (4077us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772396.553115:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:1.0:1790772396.556309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772396.559480:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530688 00000100:00100000:2.0:1790772396.559504:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530688 00000100:00100000:2.0:1790772396.559600:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:2.0:1790772396.559699:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530688:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772396.560034:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:5597:x1877760796530688:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 362us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772396.560056:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:1.0:1790772396.576466:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772396.576647:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530816 00000100:00100000:2.0:1790772396.576681:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530816 00000100:00100000:2.0:1790772396.576757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:2.0:1790772396.576768:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:6126:x1877760796530816:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772396.577114:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:6126:x1877760796530816:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 346us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772396.577123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:3.0:1790772396.603596:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772396.603786:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796530944 00000100:00100000:0.0:1790772396.603802:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796530944 00000100:00100000:0.0:1790772396.603912:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:0.0:1790772396.603923:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:6126:x1877760796530944:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772396.604189:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:6126:x1877760796530944:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 267us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772396.604207:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00010000:00010000:2.0:1790772396.811221:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772397.682327:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772397.682381:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772397.682415:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772397.682444:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772397.682480:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531328 00000100:00100000:1.0:1790772397.682493:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531328 00000100:00100000:1.0:1790772397.682569:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531456 00000100:00100000:1.0:1790772397.682572:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531456 00000100:00100000:1.0:1790772397.682595:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1790772397.682606:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796531328:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772397.682761:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796531328:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 156us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772397.682770:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1790772397.682790:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1790772397.682797:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796531456:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772397.682862:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796531456:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 66us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772397.682870:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1790772397.682933:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531200 00000100:00100000:1.0:1790772397.682937:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531200 00000100:00100000:1.0:1790772397.682974:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:1.0:1790772397.682981:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796531200:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772397.683012:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796531200:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772397.683031:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00080000:1.0:1790772397.683056:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772397.683062:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772397.683064:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772397.683300:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531072 00000100:00100000:3.0:1790772397.683307:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531072 00000100:00100000:3.0:1790772397.683342:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:3.0:1790772397.683351:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2354:x1877760796531072:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772397.683390:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2354:x1877760796531072:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 41us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772397.683396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00010000:00010000:2.0:1790772397.835399:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790772397.964121:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790772397.964135:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328bb7d8800 from 4 10000000:01000000:2.0:1790772397.964141:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790772397.964211:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772397.964226:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772397.964242:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772397.964277:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772397.964374:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772397.964450:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772397.964524:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336320 00000100:00100000:0.0:1790772397.964535:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336320 00000100:00100000:0.0:1790772397.964603:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790772397.964616:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813336320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772397.964634:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772397.964651:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be154a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772397.964680:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be154a expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772397.964693:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be154a expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772397.964703:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be600, rc 0) 00000100:00100000:0.0:1790772397.964765:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813336320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772397.964772:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790772397.964824:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772397.964841:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772397.964850:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772397.964921:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.964945:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772397.964972:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f151f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772397.970145:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336448 00000100:00100000:0.0:1790772397.970170:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336448 00000100:00100000:0.0:1790772397.970342:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790772397.970360:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813336448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772397.970748:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813336448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772397.970757:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790772397.972228:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.972320:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.972408:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772397.972455:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f151f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772397.974775:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336576 00000100:00100000:0.0:1790772397.974805:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336576 00000100:00100000:0.0:1790772397.974867:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790772397.974890:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813336576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772397.975215:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813336576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 339us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772397.975224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790772397.976334:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.976782:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8599:1877760813336704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772397.976847:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772397.976903:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f151600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772397.976963:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336704 00000100:00100000:1.0:1790772397.976969:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336704 00000100:00100000:1.0:1790772397.977003:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790772397.977012:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8599:x1877760813336704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772397.977557:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8599:x1877760813336704:12345-0@lo:502:llog_process_th.0 Request processed in 545us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772397.977565:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790772397.988977:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8599:1877760813336704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772397.989059:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772397.989072:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772397.989075:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790772397.989085:0:8599:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9328bb7d8800 00000020:00000080:3.0:1790772397.989088:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772397.989243:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8599:1877760813336832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772397.990920:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772397.990960:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772397.991031:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336832 00000100:00100000:3.0:1790772397.991041:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336832 00000100:00100000:3.0:1790772397.991155:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790772397.991164:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8599:x1877760813336832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772397.991569:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:8599:x1877760813336832:12345-0@lo:502:llog_process_th.0 Request processed in 405us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772397.991576:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790772397.991661:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8599:1877760813336832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772397.991691:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772397.991699:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772397.991701:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790772397.991717:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790772397.991907:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790772397.992072:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772397.992141:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772397.992151:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772397.992161:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790772397.992163:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328ba5e9800 from 4 10000000:01000000:3.0:1790772397.992165:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772397.992200:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772397.992207:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772397.992218:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772397.994171:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.994322:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772397.994450:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772397.995183:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813336960 00000100:00100000:0.0:1790772397.995196:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813336960 00000100:00100000:0.0:1790772397.995348:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790772397.995358:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813336960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772397.995428:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772397.995450:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1558 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772397.995481:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1558 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772397.995490:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1558 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772397.995497:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bfa00, rc 0) 00000100:00100000:0.0:1790772397.995556:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813336960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772397.995561:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790772397.996027:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813336960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772397.996050:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772397.996060:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772397.996190:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.996237:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772397.996332:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772397.997418:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337088 00000100:00100000:1.0:1790772397.997428:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337088 00000100:00100000:1.0:1790772397.997471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790772397.997478:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813337088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772397.998735:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813337088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1252us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772397.998753:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790772397.998907:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.998957:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772397.998997:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772397.999045:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772398.000059:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337216 00000100:00100000:0.0:1790772398.000070:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337216 00000100:00100000:1.0:1790772398.002347:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790772398.002735:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813337216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772398.003064:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813337216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 705us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772398.003074:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790772398.004185:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772398.006523:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8604:1877760813337344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772398.006611:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772398.006656:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772398.007410:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337344 00000100:00100000:0.0:1790772398.007425:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337344 00000100:00100000:0.0:1790772398.007480:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790772398.007488:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8604:x1877760813337344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772398.007717:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8604:x1877760813337344:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772398.007724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790772398.008922:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8604:1877760813337344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772398.008964:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772398.008973:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772398.008976:0:8604:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790772398.008982:0:8604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9328ba5e9800 00000020:00000080:3.0:1790772398.008984:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772398.011461:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8604:1877760813337472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772398.011556:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772398.011606:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772398.011670:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337472 00000100:00100000:1.0:1790772398.011679:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337472 00000100:00100000:1.0:1790772398.011728:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790772398.011735:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8604:x1877760813337472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772398.012742:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:8604:x1877760813337472:12345-0@lo:502:llog_process_th.0 Request processed in 1003us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772398.012752:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790772398.013508:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8604:1877760813337472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772398.013557:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772398.013567:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772398.013571:0:8604:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790772398.013577:0:8604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790772398.014788:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790772398.014816:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772398.014828:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.014840:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772398.014849:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772398.014852:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891b62000 from 4 10000000:01000000:0.0:1790772398.014854:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772398.014915:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.014923:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.014931:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772398.014955:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772398.015035:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772398.016462:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772398.016512:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337600 00000100:00100000:0.0:1790772398.016531:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337600 00000100:00100000:0.0:1790772398.016599:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790772398.016611:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813337600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772398.016631:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772398.016654:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be1566 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.016690:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be1566 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.016703:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1566 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.016714:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bf400, rc 0) 00000100:00100000:0.0:1790772398.016797:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813337600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772398.016804:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790772398.016864:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772398.016901:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.016912:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772398.016988:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772398.017036:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772398.017070:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772398.018482:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337728 00000100:00100000:0.0:1790772398.018503:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337728 00000100:00100000:0.0:1790772398.018556:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790772398.018565:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813337728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772398.020566:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813337728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1990us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772398.020582:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790772398.020673:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772398.020744:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772398.020801:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772398.025156:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772398.029475:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337856 00000100:00100000:3.0:1790772398.029493:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337856 00000100:00100000:3.0:1790772398.029571:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790772398.029586:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813337856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772398.029923:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813337856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 335us (9119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772398.029933:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790772398.030033:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813337856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772398.037657:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8606:1877760813337984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772398.037772:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772398.037969:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772398.038985:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813337984 00000100:00100000:0.0:1790772398.038998:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813337984 00000100:00100000:0.0:1790772398.039070:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790772398.039090:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:8606:x1877760813337984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772398.039500:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:8606:x1877760813337984:12345-0@lo:502:llog_process_th.0 Request processed in 419us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772398.039508:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790772398.040113:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8606:1877760813337984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772398.040154:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772398.040165:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772398.040167:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790772398.040176:0:8606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff932891b62000 00000020:00000080:2.0:1790772398.040178:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790772398.040260:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8606:1877760813338112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772398.040323:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772398.040465:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772398.040567:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338112 00000100:00100000:0.0:1790772398.040573:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338112 00000100:00100000:0.0:1790772398.040629:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1790772398.040635:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:8606:x1877760813338112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772398.040799:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:8606:x1877760813338112:12345-0@lo:502:llog_process_th.0 Request processed in 163us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772398.040804:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790772398.040949:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:8606:1877760813338112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772398.040967:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772398.040971:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772398.040972:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790772398.040976:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790772398.041199:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790772398.041222:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772398.041243:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772398.041258:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772398.859289:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772399.315852:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813338240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772399.315978:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772399.316153:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338240 00000100:00100000:0.0:1790772399.316164:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338240 00000100:00100000:0.0:1790772399.316243:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790772399.316254:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813338240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772399.316305:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790772399.316436:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772399.324231:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813338240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7959us (8233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772399.324257:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790772399.324626:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba717b80 x1877760813338240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772399.324673:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813338240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790772399.883716:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772400.843482:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813338496:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.843549:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772400.843609:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813339008:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.843635:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772400.843669:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772400.843692:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813338368:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.843721:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772400.843744:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813338880:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.843765:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772400.843789:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813338624:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.843812:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772400.843831:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772400.843850:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813338752:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.843894:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772400.843924:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338496 00000100:00100000:0.0:1790772400.843931:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338496 00000100:00100000:0.0:1790772400.843984:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338880 00000100:00100000:0.0:1790772400.843988:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338880 00000100:00100000:0.0:1790772400.844012:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338624 00000100:00100000:0.0:1790772400.844015:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338624 00000100:00100000:0.0:1790772400.844032:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772400.844040:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813338496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844093:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813338496:12345-0@lo:400:kworker.0 Request processed in 52us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772400.844101:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772400.844118:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790772400.844124:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844152:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813338880:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772400.844158:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790772400.844170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790772400.844176:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813338624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844205:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813338624:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772400.844211:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790772400.844228:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339008 00000100:00100000:0.0:1790772400.844232:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339008 00000100:00100000:0.0:1790772400.844255:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338752 00000100:00100000:0.0:1790772400.844257:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338752 00000100:00100000:0.0:1790772400.844270:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790772400.844284:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813339008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844315:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813339008:12345-0@lo:400:kworker.0 Request processed in 32us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772400.844320:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790772400.844332:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772400.844337:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813338752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844361:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813338752:12345-0@lo:400:kworker.0 Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772400.844366:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772400.844383:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813338368 00000100:00100000:0.0:1790772400.844387:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813338368 00000100:00100000:0.0:1790772400.844409:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1790772400.844415:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844443:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813338368:12345-0@lo:400:kworker.0 Request processed in 27us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772400.844449:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1790772400.844486:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772400.844491:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772400.844525:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb00380 x1877760813338752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772400.844539:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813338752:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844548:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813338624:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844575:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813338368:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844583:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813338880:0@lo:400:kworker.0 00000100:00100000:0.0:1790772400.844604:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813338496:0@lo:400:kworker.0 00010000:00080000:0.0:1790772400.844613:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb00700 x1877760813339008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772400.844620:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813339008:0@lo:400:kworker.0 00010000:00010000:2.0:1790772400.907014:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772401.355184:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813339136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772401.355252:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772401.355321:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339136 00000100:00100000:1.0:1790772401.355329:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339136 00000100:00100000:1.0:1790772401.355371:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790772401.355380:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813339136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772401.355416:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772401.355460:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813339136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772401.355467:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790772401.355520:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328ba717800 x1877760813339136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772401.355536:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813339136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772401.932302:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772402.506371:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1790772402.806147:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772402.806198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772402.806228:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772402.806267:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772402.806353:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531584 00000100:00100000:2.0:1790772402.806363:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531584 00000100:00100000:2.0:1790772402.806420:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:2.0:1790772402.806431:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796531584:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772402.806492:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531840 00000100:00100000:3.0:1790772402.806497:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531840 00000100:00100000:2.0:1790772402.806516:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796531584:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772402.806534:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531968 00000100:00100000:2.0:1790772402.806536:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:3.0:1790772402.806537:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531968 00000100:00100000:3.0:1790772402.806551:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1790772402.806557:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796531840:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772402.806584:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796531840:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772402.806591:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1790772402.806602:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1790772402.806608:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796531968:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772402.806629:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796531968:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772402.806635:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00080000:3.0:1790772402.806649:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772402.806653:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772402.808092:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796531712 00000100:00100000:1.0:1790772402.808110:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796531712 00000100:00100000:1.0:1790772402.808226:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00080000:3.0:1790772402.808228:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772402.808241:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796531712:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772402.808360:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796531712:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 124us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772402.808368:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00010000:00010000:2.0:1790772402.956401:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772403.979151:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772404.433451:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772404.433476:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813339264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772404.433549:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772404.435734:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339264 00000100:00100000:0.0:1790772404.435747:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339264 00000100:00100000:0.0:1790772404.435832:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790772404.435843:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813339264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772404.435913:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772404.436000:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813339264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772404.436008:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790772404.436059:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90a80 x1877760813339264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772404.436082:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813339264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790772404.438496:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772405.003368:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772405.963349:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813339392:0@lo:400:kworker.0 00000100:00100000:2.0:1790772405.963458:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772405.963525:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813339904:0@lo:400:kworker.0 00000100:00100000:2.0:1790772405.963556:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772405.963585:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790772405.963591:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813339520:0@lo:400:kworker.0 00000100:00100000:2.0:1790772405.963614:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772405.963630:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813340032:0@lo:400:kworker.0 00000100:00100000:2.0:1790772405.963655:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772405.963696:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340032 00000100:00100000:2.0:1790772405.963706:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340032 00000100:00100000:2.0:1790772405.963791:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772405.963802:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813340032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772405.963866:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813340032:12345-0@lo:400:kworker.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772405.964043:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790772405.964074:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790772405.964114:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90a80 x1877760813340032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772405.964130:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813340032:0@lo:400:kworker.0 00000100:00100000:1.0:1790772405.964236:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339392 00000100:00100000:1.0:1790772405.964243:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339392 00000100:00100000:1.0:1790772405.964273:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790772405.964281:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813339392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772405.964325:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813339392:12345-0@lo:400:kworker.0 Request processed in 45us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772405.964332:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790772405.964420:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813339392:0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.964540:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813339648:0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.964830:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772405.964897:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772405.964984:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813339776:0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965016:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772405.965058:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339904 00000100:00100000:0.0:1790772405.965063:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339904 00000100:00100000:0.0:1790772405.965105:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339520 00000100:00100000:0.0:1790772405.965117:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339520 00000100:00100000:0.0:1790772405.965133:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339648 00000100:00100000:0.0:1790772405.965136:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339648 00000100:00100000:0.0:1790772405.965151:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772405.965158:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813339904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965206:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813339904:12345-0@lo:400:kworker.0 Request processed in 48us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772405.965213:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772405.965228:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790772405.965234:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813339520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965264:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813339520:12345-0@lo:400:kworker.0 Request processed in 30us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772405.965269:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790772405.965279:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790772405.965285:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813339648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965315:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813339648:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772405.965321:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790772405.965342:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813339776 00000100:00100000:0.0:1790772405.965346:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813339776 00000100:00100000:0.0:1790772405.965370:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772405.965377:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813339776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965408:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813339776:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772405.965415:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1790772405.965435:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772405.965459:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f92a00 x1877760813339776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772405.965481:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813339776:0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965494:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813339648:0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965529:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813339520:0@lo:400:kworker.0 00000100:00100000:0.0:1790772405.965540:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813339904:0@lo:400:kworker.0 00010000:00010000:2.0:1790772406.027978:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772406.475670:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813340160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772406.475759:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772406.475935:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340160 00000100:00100000:1.0:1790772406.475943:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340160 00000100:00100000:1.0:1790772406.475994:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772406.476003:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813340160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772406.476042:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772406.476097:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813340160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772406.476104:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1790772406.476144:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f91500 x1877760813340160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772406.476172:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813340160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772407.051985:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772407.922785:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772407.922831:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772407.922962:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532096 00000100:00100000:1.0:1790772407.922973:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532096 00000100:00100000:1.0:1790772407.923032:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:1.0:1790772407.923043:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2354:x1877760796532096:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772407.923123:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2354:x1877760796532096:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 81us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772407.923131:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:2.0:1790772407.927452:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532224 00000100:00100000:2.0:1790772407.927471:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532224 00000100:00100000:2.0:1790772407.927567:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1790772407.927578:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796532224:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772407.927668:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796532224:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772407.927676:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00080000:0.0:1790772407.928119:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772407.937996:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772407.938036:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772407.938068:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532352 00000100:00100000:3.0:1790772407.938078:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532352 00000100:00100000:3.0:1790772407.938135:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532480 00000100:00100000:3.0:1790772407.938139:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532480 00000100:00100000:3.0:1790772407.938158:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772407.938167:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2353:x1877760796532352:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1790772407.938204:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be14a9 00000100:00080000:3.0:1790772407.938214:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9328bfb0a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772407.938250:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790772407.938604:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+2:2353:x1877760796532352:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 436us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772407.938613:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772407.938629:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1790772407.938636:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2353:x1877760796532480:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1790772407.938649:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be14b0 00000100:00080000:3.0:1790772407.938656:0:6704:0:(import.c:65:import_set_state_nolock()) ffff93288f0a1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772407.938676:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790772407.938895:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+2:2353:x1877760796532480:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 239us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772407.938902:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:3.0:1790772407.938921:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772407.938932:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772407.938992:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772407.939109:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772408.076979:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772408.630921:0:9066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing yml_node 00010000:00010000:3.0:1790772409.103517:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772409.554382:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772409.554406:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813340288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772409.554476:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772409.554542:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340288 00000100:00100000:1.0:1790772409.554550:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340288 00000100:00100000:1.0:1790772409.554598:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790772409.554607:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813340288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772409.554651:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772409.554697:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813340288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772409.554705:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1790772409.554745:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f91500 x1877760813340288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772409.554765:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813340288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790772409.554927:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772410.125595:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772411.084753:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813340672:0@lo:400:kworker.0 00000100:00100000:3.0:1790772411.084845:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772411.084977:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813340544:0@lo:400:kworker.0 00000100:00100000:1.0:1790772411.085008:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772411.085042:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772411.085048:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813340416:0@lo:400:kworker.0 00000100:00100000:1.0:1790772411.085087:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772411.085139:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340672 00000100:00100000:1.0:1790772411.085147:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340672 00000100:00100000:1.0:1790772411.085193:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340544 00000100:00100000:1.0:1790772411.085196:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340544 00000100:00100000:1.0:1790772411.085216:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790772411.085225:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813340672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.085323:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772411.085333:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813340544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.085375:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813340544:12345-0@lo:400:kworker.0 Request processed in 43us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772411.085381:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772411.085404:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340416 00000100:00100000:2.0:1790772411.085407:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340416 00000100:00100000:2.0:1790772411.085431:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790772411.085438:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813340416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.085468:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813340416:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772411.085475:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790772411.085522:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813340416:0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.085535:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813340544:0@lo:400:kworker.0 00000100:00080000:2.0:1790772411.085563:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772411.086215:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813340800:0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.086268:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772411.086307:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340800 00000100:00100000:2.0:1790772411.086312:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340800 00000100:00100000:2.0:1790772411.086345:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772411.086352:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813340800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.086390:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813340800:12345-0@lo:400:kworker.0 Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772411.086395:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790772411.086415:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790772411.086434:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb00380 x1877760813340800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772411.086445:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813340800:0@lo:400:kworker.0 00000100:00100000:1.0:1790772411.092285:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813340672:12345-0@lo:400:kworker.0 Request processed in 7050us (7430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772411.092311:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772411.093848:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813340928:0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.093944:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772411.093990:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772411.093996:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813341056:0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.094022:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772411.094055:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341056 00000100:00100000:2.0:1790772411.094063:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341056 00000100:00100000:2.0:1790772411.094120:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772411.094128:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813341056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772411.094188:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813341056:12345-0@lo:400:kworker.0 Request processed in 60us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772411.094195:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790772411.094214:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790772411.094243:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb01f80 x1877760813341056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772411.094269:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813341056:0@lo:400:kworker.0 00000100:00100000:0.0:1790772411.094475:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813340928 00000100:00100000:0.0:1790772411.094480:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813340928 00000100:00100000:0.0:1790772411.094522:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790772411.094528:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813340928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772411.094569:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813340928:12345-0@lo:400:kworker.0 Request processed in 40us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772411.094575:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790772411.094603:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813340928:0@lo:400:kworker.0 00000100:00080000:2.0:1790772411.095249:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772411.098208:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813340672:0@lo:400:kworker.0 00010000:00010000:0.0:1790772411.147156:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772411.595236:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772411.595259:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813341184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772411.595327:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772411.595710:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341184 00000100:00100000:1.0:1790772411.595719:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341184 00000100:00100000:1.0:1790772411.595764:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772411.595773:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813341184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772411.595837:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772411.595935:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813341184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772411.595943:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1790772411.595986:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f92a00 x1877760813341184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772411.596004:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813341184:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790772411.676570:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:3.0:1790772411.676579:0:6730:0:(genops.c:885:class_export_put()) final put ffff9328bfb0d000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:2.0:1790772411.676662:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bfb0d000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 for lustre-OST0000 00000020:00000080:2.0:1790772411.676795:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bfb0a000 for lustre-OST0000 00000001:00100000:0.0:1790772412.179597:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:0.0:1790772412.179606:0:7658:0:(genops.c:885:class_export_put()) final put ffff93288f0a3000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:1.0:1790772412.179676:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f0a3000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 for lustre-OST0001 00000020:00000080:1.0:1790772412.179732:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f0a1000 for lustre-OST0001 00010000:00010000:3.0:1790772412.182061:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772413.041573:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772413.041622:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772413.041726:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532608 00000100:00100000:1.0:1790772413.041736:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532608 00000100:00100000:1.0:1790772413.041810:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:1.0:1790772413.041820:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796532608:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772413.041934:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796532608:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 114us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772413.041941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:3.0:1790772413.042902:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532736 00000100:00100000:3.0:1790772413.042910:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532736 00000100:00100000:3.0:1790772413.042970:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1790772413.042979:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796532736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772413.043044:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796532736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 66us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772413.043051:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00080000:0.0:1790772413.043354:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772413.195610:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772414.219219:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772414.667111:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772414.667147:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813341312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772414.667243:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772414.670636:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341312 00000100:00100000:1.0:1790772414.670661:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341312 00000100:00100000:1.0:1790772414.670778:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772414.670791:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813341312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772414.670847:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772414.671002:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813341312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772414.671012:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1790772414.671064:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f92a00 x1877760813341312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772414.671100:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813341312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772414.671564:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1790772414.698371:0:9261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.4 00010000:00010000:3.0:1790772415.243289:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772416.203383:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772416.203442:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772416.203463:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813341568:0@lo:400:kworker.0 00000100:00100000:0.0:1790772416.203546:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772416.203951:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341568 00000100:00100000:2.0:1790772416.203959:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341568 00000100:00100000:2.0:1790772416.204012:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772416.204021:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813341568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772416.204077:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813341568:12345-0@lo:400:kworker.0 Request processed in 57us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772416.204084:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790772416.204172:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813341568:0@lo:400:kworker.0 00000100:00100000:1.0:1790772416.208655:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813341440:0@lo:400:kworker.0 00000100:00100000:1.0:1790772416.209148:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772416.209327:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813341696:0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.209362:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772416.209415:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772416.209421:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813341824:0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.209446:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772416.209499:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341696 00000100:00100000:3.0:1790772416.209513:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341696 00000100:00100000:3.0:1790772416.209567:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790772416.209576:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813341696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.209625:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813341696:12345-0@lo:400:kworker.0 Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772416.209633:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790772416.209654:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341824 00000100:00100000:3.0:1790772416.209657:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341824 00000100:00100000:3.0:1790772416.209683:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772416.209695:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813341824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.209733:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813341824:12345-0@lo:400:kworker.0 Request processed in 45us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772416.209739:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1790772416.209767:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772416.209771:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790772416.209810:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888345880 x1877760813341824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772416.209823:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813341824:0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.209834:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813341696:0@lo:400:kworker.0 00000100:00100000:0.0:1790772416.212845:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813341952:0@lo:400:kworker.0 00000100:00100000:0.0:1790772416.212969:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772416.213012:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772416.213019:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813342080:0@lo:400:kworker.0 00000100:00100000:0.0:1790772416.213044:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772416.213104:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342080 00000100:00100000:0.0:1790772416.213111:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342080 00000100:00100000:0.0:1790772416.213163:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772416.213172:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813342080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772416.213221:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813342080:12345-0@lo:400:kworker.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772416.213227:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790772416.213263:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790772416.213298:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888346a00 x1877760813342080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772416.213312:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813342080:0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.214364:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341952 00000100:00100000:3.0:1790772416.214373:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341952 00000100:00100000:3.0:1790772416.214413:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772416.214420:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813341952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772416.214475:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813341952:12345-0@lo:400:kworker.0 Request processed in 55us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772416.214481:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790772416.214493:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813341952:0@lo:400:kworker.0 00000100:00080000:0.0:1790772416.214642:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772416.218444:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813341440 00000100:00100000:2.0:1790772416.218460:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813341440 00000100:00100000:2.0:1790772416.218706:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790772416.218717:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813341440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772416.218841:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813341440:12345-0@lo:400:kworker.0 Request processed in 125us (9693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772416.218863:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790772416.219099:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813341440:0@lo:400:kworker.0 00010000:00010000:3.0:1790772416.267381:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772416.717372:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772416.717400:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813342208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772416.717471:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772416.717623:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342208 00000100:00100000:1.0:1790772416.717632:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342208 00000100:00100000:1.0:1790772416.717687:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772416.717705:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813342208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772416.717759:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772416.717818:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813342208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772416.717825:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1790772416.718065:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90380 x1877760813342208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772416.718082:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813342208:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772417.295570:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772417.701698:0:9358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.4 00000100:00100000:2.0:1790772418.162041:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772418.162112:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772418.162257:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532864 00000100:00100000:0.0:1790772418.162271:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532864 00000100:00100000:0.0:1790772418.162344:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:0.0:1790772418.162356:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796532864:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772418.162467:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796532864:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 113us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772418.162476:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:1.0:1790772418.163193:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796532992 00000100:00100000:1.0:1790772418.163201:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796532992 00000100:00100000:1.0:1790772418.163266:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1790772418.163276:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796532992:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772418.163338:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796532992:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 63us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772418.163345:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00080000:0.0:1790772418.167322:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790772418.318210:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772419.340590:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772419.789082:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813342336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772419.789183:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772419.791165:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342336 00000100:00100000:1.0:1790772419.791187:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342336 00000100:00100000:1.0:1790772419.791302:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772419.791314:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813342336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772419.791370:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790772419.791524:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772419.791844:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813342336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 532us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772419.791853:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1790772419.793845:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90a80 x1877760813342336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772419.793932:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813342336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790772420.368044:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772421.287458:0:9456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.4 00000100:00100000:0.0:1790772421.323580:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813342592:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.323698:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772421.323762:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813343104:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.323793:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772421.323830:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772421.323836:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813342464:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.323868:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772421.323933:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813342976:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.323958:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772421.323995:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813342720:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324017:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772421.324035:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772421.324040:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813342848:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324061:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772421.324108:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342592 00000100:00100000:0.0:1790772421.324118:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342592 00000100:00100000:0.0:1790772421.324176:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342976 00000100:00100000:0.0:1790772421.324179:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342976 00000100:00100000:0.0:1790772421.324201:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342720 00000100:00100000:0.0:1790772421.324204:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342720 00000100:00100000:0.0:1790772421.324234:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790772421.324242:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813342592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324305:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813342592:12345-0@lo:400:kworker.0 Request processed in 63us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772421.324313:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790772421.324330:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790772421.324336:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813342976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324363:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813342976:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772421.324369:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790772421.324380:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790772421.324386:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813342720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324417:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813342720:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772421.324424:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790772421.324440:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343104 00000100:00100000:0.0:1790772421.324443:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343104 00000100:00100000:0.0:1790772421.324467:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342848 00000100:00100000:0.0:1790772421.324470:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342848 00000100:00100000:0.0:1790772421.324482:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772421.324487:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813343104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324516:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813343104:12345-0@lo:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772421.324522:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772421.324532:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772421.324537:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813342848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324572:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813342848:12345-0@lo:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772421.324578:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772421.324596:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813342464 00000100:00100000:0.0:1790772421.324599:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813342464 00000100:00100000:0.0:1790772421.324636:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790772421.324643:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813342464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324675:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813342464:12345-0@lo:400:kworker.0 Request processed in 32us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772421.324681:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1790772421.324725:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772421.324731:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772421.324734:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772421.324774:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888281880 x1877760813342848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772421.324792:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813342848:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324804:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813342720:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324836:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813342464:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324845:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813342976:0@lo:400:kworker.0 00000100:00100000:0.0:1790772421.324856:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813342592:0@lo:400:kworker.0 00010000:00080000:0.0:1790772421.324866:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1183480 x1877760813343104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772421.324898:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813343104:0@lo:400:kworker.0 00010000:00010000:1.0:1790772421.390825:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772421.837220:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772421.837246:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813343232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772421.837321:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772421.837470:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343232 00000100:00100000:2.0:1790772421.837479:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343232 00000100:00100000:2.0:1790772421.837529:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772421.837539:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813343232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772421.837575:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772421.837655:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813343232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772421.837672:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790772421.837844:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f90a80 x1877760813343232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772421.837863:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813343232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772422.412743:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772423.286821:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772423.286954:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772423.287303:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533120 00000100:00100000:3.0:1790772423.287318:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533120 00000100:00100000:3.0:1790772423.287388:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:3.0:1790772423.287409:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2355:x1877760796533120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772423.287512:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2355:x1877760796533120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 105us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772423.287521:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:0.0:1790772423.287983:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533248 00000100:00100000:0.0:1790772423.287990:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533248 00000100:00100000:0.0:1790772423.288051:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1790772423.288060:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796533248:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772423.288103:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796533248:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772423.288111:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00080000:3.0:1790772423.288451:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772423.435840:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772423.514159:0:9506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 30 08:47:01 EDT 2026 00010000:00010000:0.0:1790772424.465868:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772424.907276:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772424.907307:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813343360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772424.907420:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772424.907795:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343360 00000100:00100000:2.0:1790772424.907808:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343360 00000100:00100000:2.0:1790772424.908057:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772424.908070:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813343360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772424.908121:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772424.908194:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813343360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772424.908202:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790772424.908265:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f92a00 x1877760813343360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772424.908289:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813343360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772424.908523:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772425.511865:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772426.447120:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813343744:0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.447120:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813343488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772426.452043:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813343616:0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.456865:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772426.456994:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813344000:0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.457044:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772426.457266:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343488 00000100:00100000:1.0:1790772426.457276:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343488 00000100:00100000:1.0:1790772426.457337:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790772426.457348:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813343488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.457422:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813343488:12345-0@lo:400:kworker.0 Request processed in 74us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772426.457431:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790772426.457475:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344000 00000100:00100000:1.0:1790772426.457479:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344000 00000100:00100000:1.0:1790772426.457536:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790772426.457544:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813344000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.457591:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813344000:12345-0@lo:400:kworker.0 Request processed in 48us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772426.457597:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1790772426.457620:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772426.457653:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813343488:0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.457668:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813344000:0@lo:400:kworker.0 00000100:00100000:2.0:1790772426.457805:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772426.457853:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772426.457863:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813343872:0@lo:400:kworker.0 00000100:00100000:2.0:1790772426.457911:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772426.457949:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343744 00000100:00100000:2.0:1790772426.457953:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343744 00000100:00100000:2.0:1790772426.457988:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790772426.457994:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813343744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772426.458037:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813343744:12345-0@lo:400:kworker.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772426.458043:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790772426.458075:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343872 00000100:00100000:2.0:1790772426.458079:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343872 00000100:00100000:2.0:1790772426.458110:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790772426.458117:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813343872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772426.458151:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813343872:12345-0@lo:400:kworker.0 Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772426.458157:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790772426.458194:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cf800 x1877760813343872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772426.458206:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813343872:0@lo:400:kworker.0 00000100:00100000:2.0:1790772426.458218:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813343744:0@lo:400:kworker.0 00000100:00080000:1.0:1790772426.459088:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772426.459096:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772426.462398:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772426.462556:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813344128:0@lo:400:kworker.0 00000100:00100000:0.0:1790772426.462625:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772426.462920:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344128 00000100:00100000:2.0:1790772426.462931:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344128 00000100:00100000:2.0:1790772426.463007:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790772426.463020:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813344128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772426.463098:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813344128:12345-0@lo:400:kworker.0 Request processed in 81us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772426.463120:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790772426.463550:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813343616 00000100:00100000:1.0:1790772426.463557:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813343616 00000100:00100000:1.0:1790772426.463623:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790772426.463633:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813343616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772426.463688:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813343616:12345-0@lo:400:kworker.0 Request processed in 57us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772426.463696:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1790772426.464392:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772426.464496:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813343616:0@lo:400:kworker.0 00010000:00080000:0.0:1790772426.464563:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cd180 x1877760813344128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772426.464594:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813344128:0@lo:400:kworker.0 00010000:00010000:3.0:1790772426.519860:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772426.956252:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772426.956297:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813344256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772426.956400:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772426.956492:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344256 00000100:00100000:2.0:1790772426.956502:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344256 00000100:00100000:2.0:1790772426.956571:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790772426.956582:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813344256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772426.956631:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772426.956688:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813344256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772426.956697:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1790772426.956753:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0ced80 x1877760813344256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772426.956776:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813344256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772427.533949:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772428.399744:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772428.400665:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772428.404722:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533376 00000100:00100000:0.0:1790772428.404752:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533376 00000100:00100000:0.0:1790772428.404835:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:0.0:1790772428.404862:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796533376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772428.405000:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796533376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 139us (5274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772428.405008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:2.0:1790772428.406422:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533504 00000100:00100000:2.0:1790772428.406442:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533504 00000100:00080000:0.0:1790772428.406532:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772428.406538:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:2.0:1790772428.406549:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796533504:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772428.406621:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796533504:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (5959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772428.406629:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:3.0:1790772428.556377:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772429.579216:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772430.028190:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813344384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772430.028263:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772430.028347:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344384 00000100:00100000:2.0:1790772430.028355:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344384 00000100:00100000:2.0:1790772430.028406:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790772430.028416:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813344384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772430.028452:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772430.028505:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813344384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772430.028512:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790772430.028554:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b49c00 x1877760813344384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772430.028572:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813344384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772430.028792:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772430.603638:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772431.565448:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813344896:0@lo:400:kworker.0 00000100:00100000:2.0:1790772431.565558:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772431.565624:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772431.565631:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813344768:0@lo:400:kworker.0 00000100:00100000:2.0:1790772431.565657:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772431.565688:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344896 00000100:00100000:2.0:1790772431.565696:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344896 00000100:00100000:2.0:1790772431.565752:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772431.565761:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813344896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772431.565825:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813344896:12345-0@lo:400:kworker.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772431.565833:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1790772431.565896:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfdbf480 x1877760813344896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772431.565910:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813344896:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566174:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813344512:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566209:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772431.566235:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813345024:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566257:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772431.566278:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790772431.566285:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813344640:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566307:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772431.566326:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813345152:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566346:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772431.566373:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344768 00000100:00100000:1.0:1790772431.566377:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344768 00000100:00100000:1.0:1790772431.566416:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345024 00000100:00100000:1.0:1790772431.566418:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345024 00000100:00100000:1.0:1790772431.566428:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344640 00000100:00100000:1.0:1790772431.566441:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344640 00000100:00100000:1.0:1790772431.566455:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790772431.566461:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813344768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566510:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813344768:12345-0@lo:400:kworker.0 Request processed in 48us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772431.566517:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790772431.566538:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790772431.566543:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813345024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566576:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813345024:12345-0@lo:400:kworker.0 Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772431.566581:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790772431.566592:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772431.566597:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813344640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566623:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813344640:12345-0@lo:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772431.566629:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772431.566678:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813344512 00000100:00100000:1.0:1790772431.566681:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813344512 00000100:00100000:1.0:1790772431.566706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790772431.566713:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813344512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566742:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813344512:12345-0@lo:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772431.566748:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790772431.566778:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345152 00000100:00100000:1.0:1790772431.566782:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345152 00000100:00100000:1.0:1790772431.566924:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790772431.566932:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813345152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.566963:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813345152:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772431.566969:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1790772431.566985:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772431.566989:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772431.567014:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813344640:0@lo:400:kworker.0 00010000:00080000:1.0:1790772431.567035:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfdbd180 x1877760813345152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772431.567045:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813345152:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.567053:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813344512:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.567061:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813345024:0@lo:400:kworker.0 00000100:00100000:1.0:1790772431.567099:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813344768:0@lo:400:kworker.0 00010000:00010000:3.0:1790772431.628355:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772432.084979:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813345280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772432.085065:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772432.085177:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345280 00000100:00100000:2.0:1790772432.085186:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345280 00000100:00100000:2.0:1790772432.085239:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790772432.085249:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813345280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772432.085286:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772432.085347:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813345280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772432.085353:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790772432.085610:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1197480 x1877760813345280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772432.085627:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813345280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772432.654838:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772433.519777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772433.519840:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772433.519983:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533632 00000100:00100000:0.0:1790772433.519998:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533632 00000100:00100000:0.0:1790772433.520061:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:0.0:1790772433.520073:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796533632:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772433.520186:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796533632:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 114us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772433.520195:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:3.0:1790772433.520820:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533760 00000100:00100000:3.0:1790772433.520837:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533760 00000100:00100000:3.0:1790772433.520952:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1790772433.520962:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796533760:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772433.521044:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796533760:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 84us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772433.521052:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00080000:1.0:1790772433.521227:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790772433.676859:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772434.699322:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772435.148067:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772435.148103:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813345408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772435.148215:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772435.151086:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345408 00000100:00100000:2.0:1790772435.151108:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345408 00000100:00100000:2.0:1790772435.151222:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790772435.151236:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813345408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772435.151294:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772435.151585:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813345408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 351us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772435.151594:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1790772435.152138:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790772435.152205:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1197b80 x1877760813345408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772435.152237:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813345408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790772435.723185:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772436.683573:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813345920:0@lo:400:kworker.0 00000100:00100000:3.0:1790772436.683675:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772436.683757:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772436.683764:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813345792:0@lo:400:kworker.0 00000100:00100000:3.0:1790772436.683822:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772436.683905:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345792 00000100:00100000:3.0:1790772436.683916:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345792 00000100:00100000:3.0:1790772436.683986:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790772436.683996:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813345792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772436.684062:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813345792:12345-0@lo:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.684071:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790772436.684122:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813345792:0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.684565:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813345536:0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.684614:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772436.684652:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813346048:0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.684690:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772436.684717:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790772436.684724:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813345664:0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.684748:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772436.684766:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813346176:0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.684791:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790772436.684825:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772436.684840:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346048 00000100:00100000:0.0:1790772436.684845:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346048 00000100:00100000:0.0:1790772436.684914:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345664 00000100:00100000:0.0:1790772436.684918:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345664 00000100:00100000:0.0:1790772436.684938:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790772436.684946:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813346048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.684992:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813346048:12345-0@lo:400:kworker.0 Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772436.684999:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790772436.685015:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790772436.685022:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813345664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.685050:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813345664:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772436.685056:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790772436.685079:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345920 00000100:00100000:0.0:1790772436.685083:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345920 00000100:00100000:0.0:1790772436.685111:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346176 00000100:00100000:0.0:1790772436.685114:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346176 00000100:00100000:0.0:1790772436.685128:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772436.685134:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813345920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.685188:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813345920:12345-0@lo:400:kworker.0 Request processed in 54us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772436.685194:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772436.685205:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772436.685212:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813346176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.685240:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813346176:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772436.685246:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1790772436.685281:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772436.685284:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772436.685313:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813345664:0@lo:400:kworker.0 00010000:00080000:0.0:1790772436.685328:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888347480 x1877760813346176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772436.685338:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813346176:0@lo:400:kworker.0 00000100:00100000:0.0:1790772436.685362:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813346048:0@lo:400:kworker.0 00010000:00080000:0.0:1790772436.686039:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888345180 x1877760813345920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772436.686051:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813345920:0@lo:400:kworker.0 00000100:00100000:3.0:1790772436.686511:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813345536 00000100:00100000:3.0:1790772436.686519:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813345536 00000100:00100000:3.0:1790772436.686577:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790772436.686586:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813345536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772436.686705:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813345536:12345-0@lo:400:kworker.0 Request processed in 120us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772436.686712:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790772436.696072:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813345536:0@lo:400:kworker.0 00010000:00010000:1.0:1790772436.752574:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772437.202277:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813346304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772437.202851:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772437.221060:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346304 00000100:00100000:2.0:1790772437.221088:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346304 00000100:00100000:3.0:1790772437.221264:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772437.221277:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813346304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772437.221342:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772437.221474:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813346304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (18623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772437.221483:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790772437.222177:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1195180 x1877760813346304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772437.222211:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813346304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772437.781395:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772438.643402:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772438.643451:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772438.643482:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796533888 00000100:00100000:1.0:1790772438.643492:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796533888 00000100:00100000:1.0:1790772438.643538:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:1.0:1790772438.643547:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2354:x1877760796533888:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772438.643629:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2354:x1877760796533888:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 82us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772438.643637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:3.0:1790772438.644340:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534016 00000100:00100000:3.0:1790772438.644347:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534016 00000100:00100000:3.0:1790772438.644406:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1790772438.644415:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796534016:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:0.0:1790772438.644449:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772438.644480:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796534016:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 66us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772438.644488:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00010000:00010000:3.0:1790772438.797199:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772439.821115:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772440.267069:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772440.267093:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813346432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772440.267179:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772440.267265:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346432 00000100:00100000:3.0:1790772440.267275:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346432 00000100:00100000:3.0:1790772440.267423:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790772440.267433:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813346432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772440.267468:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772440.267528:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813346432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772440.267535:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790772440.267725:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1195180 x1877760813346432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772440.267745:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813346432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790772440.267985:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772440.845101:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772441.245308:0:10137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:47:20 (1790772440) === 00000100:00100000:1.0:1790772441.797466:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772441.797934:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534144 00000100:00100000:0.0:1790772441.797947:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534144 00000100:00100000:0.0:1790772441.798016:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:0.0:1790772441.798030:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:8112:x1877760796534144:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790772441.798053:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772441.798075:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12be000/0xd3c7635991be1574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5079f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772441.798109:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12be000/0xd3c7635991be1574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5079f expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772441.798120:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12be000/0xd3c7635991be1574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5079f expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772441.798129:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be000, rc 0) 00000100:00100000:0.0:1790772441.798207:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8112:x1877760796534144:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 180us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.798214:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:3.0:1790772441.803218:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813346688:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.803311:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772441.803374:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813347200:0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.803381:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813346944:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.803399:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772441.803434:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790772441.803440:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813346560:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.803467:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772441.803488:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813347072:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.803508:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772441.803536:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346560 00000100:00100000:3.0:1790772441.803543:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346560 00000100:00100000:3.0:1790772441.803583:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790772441.803591:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813346560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.803657:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813346560:12345-0@lo:400:kworker.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.803663:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1790772441.803679:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772441.803712:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772441.803718:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813346816:0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.803742:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772441.803767:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347200 00000100:00100000:1.0:1790772441.803771:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347200 00000100:00100000:1.0:1790772441.803806:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346944 00000100:00100000:1.0:1790772441.803809:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346944 00000100:00100000:1.0:1790772441.803823:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790772441.803829:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.803863:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813347200:12345-0@lo:400:kworker.0 Request processed in 33us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.803870:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772441.803905:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813346560:0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.803908:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790772441.803914:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813346944:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790772441.803919:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1195500 x1877760813347200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772441.803930:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813347200:0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.803944:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813346944:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.803950:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1790772441.803960:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772441.803970:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346688 00000100:00100000:3.0:1790772441.803973:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346688 00010000:00080000:1.0:1790772441.803989:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1195c00 x1877760813346944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772441.803996:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347072 00000100:00100000:3.0:1790772441.803998:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347072 00000100:00100000:1.0:1790772441.804010:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813346944:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.804012:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813346816 00000100:00100000:3.0:1790772441.804014:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813346816 00000100:00100000:3.0:1790772441.804026:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790772441.804032:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813346688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.804050:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790772441.804057:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813347072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.804064:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813346688:12345-0@lo:400:kworker.0 Request processed in 34us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.804070:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790772441.804081:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772441.804084:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813347072:12345-0@lo:400:kworker.0 Request processed in 29us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.804086:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772441.804089:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790772441.804118:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813346816:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.804123:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1790772441.804136:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772441.804146:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813346816:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.804148:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813347072:0@lo:400:kworker.0 00000100:00100000:3.0:1790772441.804165:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813346688:0@lo:400:kworker.0 00000100:00100000:0.0:1790772441.808345:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.808578:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534272 00000100:00100000:1.0:1790772441.808593:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534272 00000100:00100000:1.0:1790772441.808678:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:1.0:1790772441.808691:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8112:x1877760796534272:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790772441.809186:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8112:x1877760796534272:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 487us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.809198:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:2.0:1790772441.819013:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772441.819561:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534400 00000100:00100000:0.0:1790772441.819572:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534400 00000100:00100000:0.0:1790772441.819627:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:0.0:1790772441.819637:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8112:x1877760796534400:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790772441.820083:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8112:x1877760796534400:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 446us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.820092:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:3.0:1790772441.824073:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.824237:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534528 00000100:00100000:1.0:1790772441.824247:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534528 00000100:00100000:1.0:1790772441.824318:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:1.0:1790772441.824328:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8116:x1877760796534528:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772441.824606:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8116:x1877760796534528:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 278us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.824613:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:1.0:1790772441.853702:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772441.857064:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534656 00000100:00100000:3.0:1790772441.857080:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534656 00000100:00100000:3.0:1790772441.857235:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:3.0:1790772441.857247:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8116:x1877760796534656:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772441.857575:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8116:x1877760796534656:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 330us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.857583:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 214 00010000:00010000:3.0:1790772441.872073:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772441.874059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772441.874165:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534784 00000100:00100000:0.0:1790772441.874187:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534784 00000100:00100000:0.0:1790772441.874249:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:0.0:1790772441.874268:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:8112:x1877760796534784:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790772441.874283:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772441.874302:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12be400/0xd3c7635991be157b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a507c9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772441.874331:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12be400/0xd3c7635991be157b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507c9 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772441.874342:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12be400/0xd3c7635991be157b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507c9 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772441.874352:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be400, rc 0) 00000100:00100000:0.0:1790772441.874410:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:8112:x1877760796534784:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 144us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.874417:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:0.0:1790772441.878333:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772441.878420:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796534912 00000100:00100000:3.0:1790772441.878432:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796534912 00000100:00100000:3.0:1790772441.878484:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:3.0:1790772441.878493:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:8112:x1877760796534912:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790772441.878518:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790772441.878541:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790772441.878545:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790772441.878547:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790772441.878550:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790772441.883434:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:8112:x1877760796534912:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 4931us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.883449:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:2.0:1790772441.888457:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.888601:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535040 00000100:00100000:1.0:1790772441.888644:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535040 00000100:00100000:1.0:1790772441.888781:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:1.0:1790772441.888794:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:8112:x1877760796535040:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772441.888821:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772441.888846:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a507d0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772441.888947:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772441.888960:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772441.888970:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db000, rc 0) 00000100:00100000:1.0:1790772441.889050:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8112:x1877760796535040:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 258us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.889057:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:0.0:1790772441.892381:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772441.894578:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535168 00000100:00100000:3.0:1790772441.894594:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535168 00000100:00100000:3.0:1790772441.894676:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:3.0:1790772441.894687:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8112:x1877760796535168:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772441.895032:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8112:x1877760796535168:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 345us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.895040:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:2.0:1790772441.898113:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.898203:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535296 00000100:00100000:1.0:1790772441.898216:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535296 00000100:00100000:1.0:1790772441.898318:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:1.0:1790772441.898329:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8112:x1877760796535296:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790772441.898670:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8112:x1877760796535296:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 342us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.898681:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:2.0:1790772441.903095:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772441.903732:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535424 00000100:00100000:3.0:1790772441.903746:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535424 00000100:00100000:3.0:1790772441.903822:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:3.0:1790772441.903832:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8119:x1877760796535424:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772441.904698:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8119:x1877760796535424:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 859us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772441.904711:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:3.0:1790772441.909134:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772441.909371:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535552 00000100:00100000:0.0:1790772441.909388:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535552 00000100:00100000:0.0:1790772441.909537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:0.0:1790772441.909552:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8119:x1877760796535552:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772441.909962:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:8119:x1877760796535552:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 412us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.909971:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:2.0:1790772441.920630:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.920983:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535680 00000100:00100000:1.0:1790772441.920998:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535680 00000100:00100000:1.0:1790772441.921064:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1790772441.921075:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1877760796535680:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790772441.921136:0:8380:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a4553db9-253c-4dc5-b7ca-58baa04a749a@192.168.201.34@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1790772441.921190:0:8380:0:(genops.c:1384:class_connect()) connect: client a4553db9-253c-4dc5-b7ca-58baa04a749a, cookie 0xd3c7635991be1589 00000004:00100000:1.0:1790772441.921233:0:8380:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790772441.921847:0:8380:0:(import.c:65:import_set_state_nolock()) ffff9328bf5f6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772441.922002:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:2353:x1877760796535680:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 926us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.922012:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1790772441.925615:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772441.925780:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536064 00000100:00100000:0.0:1790772441.925816:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536064 00000100:00100000:0.0:1790772441.925947:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:0.0:1790772441.925959:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796536064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772441.926074:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796536064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 118us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.926082:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00080000:3.0:1790772441.926226:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772441.930646:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.930839:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535808 00000100:00100000:1.0:1790772441.930853:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535808 00000100:00100000:1.0:1790772441.931024:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1790772441.931037:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:0:x1877760796535808:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790772441.931096:0:5855:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790772441.931204:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:0:x1877760796535808:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 170us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.931213:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:3.0:1790772441.931533:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772441.934339:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772441.937779:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796535936 00000100:00100000:0.0:1790772441.937799:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796535936 00000100:00100000:0.0:1790772441.937968:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1790772441.937986:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:8112:x1877760796535936:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772441.938028:0:5857:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790772441.938127:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:8112:x1877760796535936:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 150us (3804us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.938135:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1790772441.949984:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772441.950077:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536192 00000100:00100000:1.0:1790772441.950091:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536192 00000100:00100000:1.0:1790772441.950171:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772441.950183:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:8112:x1877760796536192:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790772441.950324:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:8112:x1877760796536192:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 143us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772441.950332:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1790772441.953776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772441.953823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772441.953952:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536320 00000100:00100000:2.0:1790772441.953965:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536320 00000100:00100000:2.0:1790772441.954437:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536448 00000100:00100000:2.0:1790772441.954442:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536448 00000100:00100000:2.0:1790772441.954459:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1790772441.954469:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877760796536320:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790772441.954510:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a4553db9-253c-4dc5-b7ca-58baa04a749a@192.168.201.34@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1790772441.954606:0:6705:0:(genops.c:1384:class_connect()) connect: client a4553db9-253c-4dc5-b7ca-58baa04a749a, cookie 0xd3c7635991be1590 00002000:00100000:2.0:1790772441.954622:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a4553db9-253c-4dc5-b7ca-58baa04a749a/ffff93288f0e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790772441.954636:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1790772441.957969:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00002000:00080000:2.0:1790772441.958161:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790772441.958218:0:6705:0:(import.c:65:import_set_state_nolock()) ffff93288f0e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772441.958404:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:2353:x1877760796536320:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 3933us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772441.958417:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1790772441.958461:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1790772441.958469:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877760796536448:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790772441.958505:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a4553db9-253c-4dc5-b7ca-58baa04a749a@192.168.201.34@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1790772441.958571:0:6705:0:(genops.c:1384:class_connect()) connect: client a4553db9-253c-4dc5-b7ca-58baa04a749a, cookie 0xd3c7635991be1597 00002000:00100000:2.0:1790772441.958588:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a4553db9-253c-4dc5-b7ca-58baa04a749a/ffff93288f0e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790772441.959247:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790772441.960098:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772441.960138:0:6705:0:(import.c:65:import_set_state_nolock()) ffff93288f0e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772441.960220:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:2353:x1877760796536448:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 1747us (6392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772441.960231:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772441.961854:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536576 00000100:00100000:1.0:1790772441.961872:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536576 00000100:00100000:0.0:1790772441.964863:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1790772441.964906:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:8112:x1877760796536576:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790772441.965029:0:5858:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790772441.965167:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:8112:x1877760796536576:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 289us (7213us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772441.965183:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1790772442.316392:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813347328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772442.316501:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772442.316592:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347328 00000100:00100000:3.0:1790772442.316601:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347328 00000100:00100000:3.0:1790772442.316660:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790772442.316670:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813347328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772442.316700:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772442.316758:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813347328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772442.316784:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1790772442.316843:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1192300 x1877760813347328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772442.316863:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813347328:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1790772442.378526:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4553db9-253c-4dc5-b7ca-58baa04a749a 00010000:00010000:0.0:1790772442.892669:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790772442.912102:0:5878:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a4553db9-253c-4dc5-b7ca-58baa04a749a 00000001:00100000:0.0:1790772442.964185:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4553db9-253c-4dc5-b7ca-58baa04a749a 00010000:00010000:0.0:1790772443.915469:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772444.939016:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772445.387912:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772445.393250:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813347456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772445.393364:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772445.397633:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347456 00000100:00100000:3.0:1790772445.397660:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347456 00000100:00100000:3.0:1790772445.398450:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772445.398465:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813347456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772445.398524:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772445.398663:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813347456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (5299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772445.398672:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1790772445.399230:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1197800 x1877760813347456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772445.399285:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813347456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772445.400601:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772445.964673:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772446.933233:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813347584:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933303:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772446.933345:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813348096:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933371:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772446.933398:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790772446.933403:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813347712:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933423:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772446.933439:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813348224:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933462:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772446.933488:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813347840:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933512:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772446.933528:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772446.933533:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813347968:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933554:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772446.933582:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348096 00000100:00100000:1.0:1790772446.933588:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348096 00000100:00100000:1.0:1790772446.933638:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347712 00000100:00100000:1.0:1790772446.933642:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347712 00000100:00100000:1.0:1790772446.933654:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347840 00000100:00100000:1.0:1790772446.933656:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347840 00000100:00100000:1.0:1790772446.933670:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772446.933677:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933732:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813348096:12345-0@lo:400:kworker.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772446.933756:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772446.933776:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790772446.933782:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813347712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933809:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813347712:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772446.933814:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790772446.933825:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790772446.933831:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813347840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933858:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813347840:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772446.933864:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790772446.933907:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348224 00000100:00100000:1.0:1790772446.933911:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348224 00000100:00100000:1.0:1790772446.933935:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347968 00000100:00100000:1.0:1790772446.933937:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347968 00000100:00100000:1.0:1790772446.933950:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790772446.933955:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813348224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.933985:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813348224:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772446.933991:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790772446.934002:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790772446.934008:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813347968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.934035:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813347968:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772446.934040:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1790772446.934069:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772446.934073:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790772446.934107:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b49180 x1877760813347968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772446.934121:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813347968:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.934132:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813347840:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.934159:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813347712:0@lo:400:kworker.0 00010000:00080000:1.0:1790772446.934185:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b4b100 x1877760813348224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772446.934191:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813348224:0@lo:400:kworker.0 00000100:00100000:1.0:1790772446.934200:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813348096:0@lo:400:kworker.0 00000100:00100000:3.0:1790772446.934749:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813347584 00000100:00100000:3.0:1790772446.934755:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813347584 00000100:00100000:3.0:1790772446.934796:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790772446.934803:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772446.934852:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813347584:12345-0@lo:400:kworker.0 Request processed in 49us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772446.934858:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790772446.934919:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813347584:0@lo:400:kworker.0 00010000:00010000:3.0:1790772446.988003:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772447.312033:0:10332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1790772447.354835:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772447.354908:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772447.354935:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772447.354954:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772447.354998:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772447.355086:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536960 00000100:00100000:1.0:1790772447.355111:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536960 00000100:00100000:1.0:1790772447.355198:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536832 00000100:00100000:1.0:1790772447.355202:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536832 00000100:00100000:1.0:1790772447.355242:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1790772447.355255:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796536960:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772447.355402:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796536960:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 149us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772447.355411:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1790772447.355432:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:1.0:1790772447.355439:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2356:x1877760796536832:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772447.355466:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2356:x1877760796536832:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772447.355484:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:1.0:1790772447.355506:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537216 00000100:00100000:1.0:1790772447.355510:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537216 00000100:00100000:1.0:1790772447.355537:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537088 00000100:00100000:1.0:1790772447.355541:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537088 00000100:00100000:1.0:1790772447.355557:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1790772447.355564:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796537216:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772447.355592:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796537216:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772447.355599:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1790772447.355610:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1790772447.355617:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796537088:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772447.355639:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796537088:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772447.355646:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00080000:3.0:1790772447.356348:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772447.356354:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772447.356357:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772447.356815:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796536704 00000100:00100000:2.0:1790772447.356825:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796536704 00000100:00100000:2.0:1790772447.356895:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:2.0:1790772447.356904:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796536704:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772447.356964:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796536704:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 62us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772447.356971:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:0.0:1790772447.435114:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813348352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772447.435239:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772447.435425:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348352 00000100:00100000:3.0:1790772447.435436:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348352 00000100:00100000:3.0:1790772447.435496:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772447.435506:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813348352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772447.435552:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772447.435613:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813348352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772447.435621:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1790772447.436143:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1191f80 x1877760813348352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772447.436183:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813348352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772448.019444:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772449.035100:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772450.059073:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772450.523914:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813348480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772450.523990:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772450.524370:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348480 00000100:00100000:3.0:1790772450.524380:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348480 00000100:00100000:3.0:1790772450.524451:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790772450.524460:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813348480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772450.524506:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772450.524564:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813348480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772450.524571:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1790772450.524727:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1191f80 x1877760813348480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772450.524747:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813348480:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772450.524832:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772451.083105:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772452.047178:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813348608:0@lo:400:kworker.0 00000100:00100000:3.0:1790772452.047259:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772452.047382:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813348864:0@lo:400:kworker.0 00000100:00100000:1.0:1790772452.047593:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772452.047662:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772452.047670:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813348992:0@lo:400:kworker.0 00000100:00100000:1.0:1790772452.047694:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772452.047731:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348608 00000100:00100000:1.0:1790772452.047739:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348608 00000100:00100000:1.0:1790772452.047778:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790772452.047787:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813348608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772452.047858:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813348608:12345-0@lo:400:kworker.0 Request processed in 72us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772452.047866:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790772452.047912:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348864 00000100:00100000:1.0:1790772452.047916:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348992 00000100:00100000:2.0:1790772452.047917:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348864 00000100:00100000:1.0:1790772452.047919:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348992 00000100:00100000:2.0:1790772452.047961:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790772452.047969:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813348864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772452.048011:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813348864:12345-0@lo:400:kworker.0 Request processed in 42us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772452.048024:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772452.048160:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813348608:0@lo:400:kworker.0 00000100:00100000:3.0:1790772452.048167:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813349120:0@lo:400:kworker.0 00000100:00100000:3.0:1790772452.048190:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772452.048218:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790772452.048224:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813348736:0@lo:400:kworker.0 00000100:00100000:3.0:1790772452.048245:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772452.048262:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813349248:0@lo:400:kworker.0 00000100:00100000:3.0:1790772452.048294:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772452.049989:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813348864:0@lo:400:kworker.0 00000100:00100000:0.0:1790772452.050027:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349120 00000100:00100000:0.0:1790772452.050033:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349120 00000100:00100000:2.0:1790772452.050125:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349248 00000100:00100000:2.0:1790772452.050131:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349248 00000100:00100000:1.0:1790772452.052749:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772452.052764:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813348992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772452.053030:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813348992:12345-0@lo:400:kworker.0 Request processed in 269us (5333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772452.053038:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1790772452.053130:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1191c00 x1877760813348992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772452.053150:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813348992:0@lo:400:kworker.0 00000100:00080000:1.0:1790772452.053959:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772452.053966:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772452.053969:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772452.056430:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813348736 00000100:00100000:0.0:1790772452.056440:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813348736 00000100:00100000:0.0:1790772452.056464:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790772452.056475:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813349120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772452.056577:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813349120:12345-0@lo:400:kworker.0 Request processed in 104us (8384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772452.056584:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790772452.056633:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813349120:0@lo:400:kworker.0 00000100:00100000:0.0:1790772452.056660:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772452.056666:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772452.056702:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813348736:12345-0@lo:400:kworker.0 Request processed in 37us (8456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772452.056723:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772452.056749:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813348736:0@lo:400:kworker.0 00000100:00100000:2.0:1790772452.061337:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772452.061358:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813349248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772452.061486:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813349248:12345-0@lo:400:kworker.0 Request processed in 136us (13190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772452.061635:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790772452.061694:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1191f80 x1877760813349248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772452.061710:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813349248:0@lo:400:kworker.0 00010000:00010000:0.0:1790772452.107453:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772452.463669:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772452.463714:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772452.463745:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772452.463772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772452.463793:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772452.463822:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537856 00000100:00100000:3.0:1790772452.463831:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537856 00000100:00100000:3.0:1790772452.463908:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537728 00000100:00100000:1.0:1790772452.464011:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537600 00000100:00100000:1.0:1790772452.464016:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537600 00000100:00100000:1.0:1790772452.464044:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537472 00000100:00100000:1.0:1790772452.464047:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537472 00000100:00100000:1.0:1790772452.464079:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1790772452.464089:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796537600:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772452.464173:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796537600:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772452.464180:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1790772452.464196:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1790772452.464215:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796537472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772452.464240:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796537472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772452.464245:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00080000:1.0:1790772452.464263:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772452.464267:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772452.464616:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537344 00000100:00100000:0.0:1790772452.464621:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537344 00000100:00100000:0.0:1790772452.464659:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:0.0:1790772452.464666:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796537344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772452.464702:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796537344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772452.464709:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:3.0:1790772452.464927:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537728 00000100:00100000:3.0:1790772452.464964:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1790772452.464972:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796537856:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772452.465011:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796537856:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772452.465018:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1790772452.465030:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1790772452.465036:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796537728:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772452.465082:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796537728:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772452.465088:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00080000:0.0:1790772452.465478:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772452.555127:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772452.555152:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813349376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772452.555230:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772452.555392:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349376 00000100:00100000:3.0:1790772452.555400:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349376 00000100:00100000:3.0:1790772452.555459:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772452.555469:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813349376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772452.555505:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772452.555553:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813349376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772452.555560:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1790772452.555785:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1192d80 x1877760813349376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772452.555802:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813349376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772453.131924:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772454.155102:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772455.180921:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772455.630157:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772455.630180:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813349504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772455.630244:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772455.635227:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349504 00000100:00100000:0.0:1790772455.635243:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349504 00000100:00100000:0.0:1790772455.635325:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790772455.635340:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813349504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772455.635396:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772455.635627:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813349504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 293us (5382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772455.635635:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1790772455.635690:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1191c00 x1877760813349504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772455.635714:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813349504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772455.638133:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772456.206167:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772457.170200:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813349888:0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.170269:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772457.170339:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349888 00000100:00100000:1.0:1790772457.170347:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349888 00000100:00100000:1.0:1790772457.170394:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790772457.170418:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813349888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.170471:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813349888:12345-0@lo:400:kworker.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772457.170479:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1790772457.170501:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772457.170538:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813349888:0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.170574:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813350016:0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.170599:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772457.170631:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350016 00000100:00100000:1.0:1790772457.170635:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350016 00000100:00100000:1.0:1790772457.170663:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790772457.170679:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813350016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.170713:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813350016:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772457.170719:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1790772457.170733:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772457.170749:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f93800 x1877760813350016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772457.170760:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813350016:0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.170932:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813349632:0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.170969:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772457.171006:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813350144:0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171028:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772457.171049:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790772457.171055:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813349760:0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171078:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772457.171102:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813350272:0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171122:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772457.171147:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350144 00000100:00100000:2.0:1790772457.171150:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350144 00000100:00100000:2.0:1790772457.171174:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349760 00000100:00100000:2.0:1790772457.171176:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349760 00000100:00100000:2.0:1790772457.171191:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790772457.171197:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813350144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171233:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813350144:12345-0@lo:400:kworker.0 Request processed in 35us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.171240:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790772457.171251:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790772457.171256:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813349760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171281:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813349760:12345-0@lo:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.171286:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790772457.171304:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350272 00000100:00100000:2.0:1790772457.171307:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350272 00000100:00100000:2.0:1790772457.171326:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790772457.171332:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813350272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171358:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813350272:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.171364:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790772457.171388:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813349760:0@lo:400:kworker.0 00010000:00080000:2.0:1790772457.171398:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0f92680 x1877760813350272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772457.171432:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813350272:0@lo:400:kworker.0 00000100:00100000:2.0:1790772457.171444:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813350144:0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.171577:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813349632 00000100:00100000:1.0:1790772457.171581:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813349632 00000100:00100000:1.0:1790772457.171617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790772457.171624:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813349632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772457.171661:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813349632:12345-0@lo:400:kworker.0 Request processed in 38us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772457.171667:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1790772457.171693:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772457.171696:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772457.171714:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813349632:0@lo:400:kworker.0 00010000:00010000:3.0:1790772457.228795:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772457.598681:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772457.598729:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772457.598768:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772457.598785:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796537984 00000100:00100000:1.0:1790772457.598791:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772457.598795:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796537984 00000100:00100000:1.0:1790772457.598812:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772457.598832:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538496 00000100:00100000:1.0:1790772457.598836:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538496 00000100:00100000:2.0:1790772457.598846:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:2.0:1790772457.598856:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796537984:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772457.598868:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538368 00000100:00100000:1.0:1790772457.598901:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538368 00000100:00100000:1.0:1790772457.598932:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1790772457.598939:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796538496:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772457.598949:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796537984:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.598957:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:1.0:1790772457.598988:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796538496:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772457.598995:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1790772457.598997:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538240 00000100:00100000:2.0:1790772457.599000:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538240 00000100:00100000:1.0:1790772457.599007:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1790772457.599012:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796538368:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772457.599036:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538112 00000100:00100000:1.0:1790772457.599037:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796538368:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.599039:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538112 00000100:00100000:1.0:1790772457.599043:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00080000:1.0:1790772457.599059:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772457.599060:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00080000:1.0:1790772457.599064:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772457.599066:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772457.599067:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796538240:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772457.599094:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796538240:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.599100:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1790772457.599112:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1790772457.599118:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796538112:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772457.599140:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796538112:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.599146:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:0.0:1790772457.676326:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813350400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772457.676427:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772457.676507:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350400 00000100:00100000:2.0:1790772457.676515:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350400 00000100:00100000:2.0:1790772457.676572:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790772457.676582:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813350400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772457.676619:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772457.676672:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813350400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772457.676678:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1790772457.676715:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1190000 x1877760813350400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772457.676732:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813350400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772458.253160:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772459.276927:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772460.301650:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772460.747123:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813350528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772460.747192:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772460.747520:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350528 00000100:00100000:1.0:1790772460.747529:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350528 00000100:00080000:3.0:1790772460.747564:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772460.747589:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790772460.747601:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813350528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772460.747648:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772460.747698:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813350528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772460.747706:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1790772460.747726:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1190000 x1877760813350528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772460.747745:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813350528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790772461.329126:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772462.286095:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813350912:0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.286175:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772462.286362:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772462.286369:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813351040:0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.286407:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772462.286441:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351040 00000100:00100000:1.0:1790772462.286448:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351040 00000100:00100000:1.0:1790772462.286501:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790772462.286510:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813351040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.286564:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813351040:12345-0@lo:400:kworker.0 Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772462.286571:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1790772462.286592:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772462.286623:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c7800 x1877760813351040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772462.286637:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813351040:0@lo:400:kworker.0 00000100:00100000:0.0:1790772462.286714:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813350784:0@lo:400:kworker.0 00000100:00100000:0.0:1790772462.286741:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772462.286764:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813351296:0@lo:400:kworker.0 00000100:00100000:0.0:1790772462.286782:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772462.286794:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772462.286798:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813350656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772462.286818:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772462.286833:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813351168:0@lo:400:kworker.0 00000100:00100000:0.0:1790772462.286848:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772462.286955:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350912 00000100:00100000:1.0:1790772462.286960:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350912 00000100:00100000:1.0:1790772462.286997:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350784 00000100:00100000:1.0:1790772462.287000:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350784 00000100:00100000:1.0:1790772462.287012:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351168 00000100:00100000:1.0:1790772462.287014:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351168 00000100:00100000:1.0:1790772462.287026:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790772462.287031:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813350912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.287065:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813350912:12345-0@lo:400:kworker.0 Request processed in 33us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772462.287070:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790772462.287082:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790772462.287086:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813350784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.287114:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813350784:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772462.287130:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790772462.287141:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790772462.287329:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351296 00000100:00100000:2.0:1790772462.287333:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351296 00000100:00100000:2.0:1790772462.287356:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772462.287363:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813351296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772462.287396:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813351296:12345-0@lo:400:kworker.0 Request processed in 34us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772462.287402:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772462.287419:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813350656 00000100:00100000:2.0:1790772462.287429:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813350656 00000100:00100000:2.0:1790772462.287452:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790772462.287458:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813350656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772462.287484:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813350656:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772462.287489:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:0.0:1790772462.288342:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772462.288347:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772462.288439:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813351168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.288485:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813351168:12345-0@lo:400:kworker.0 Request processed in 1337us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772462.288492:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790772462.288544:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813350656:0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.288555:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813351168:0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.288565:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813350784:0@lo:400:kworker.0 00010000:00080000:1.0:1790772462.288576:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c5f80 x1877760813351296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772462.288587:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813351296:0@lo:400:kworker.0 00000100:00100000:1.0:1790772462.288621:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813350912:0@lo:400:kworker.0 00010000:00010000:1.0:1790772462.347098:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772462.704216:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772462.704267:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772462.704353:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539008 00000100:00100000:2.0:1790772462.704363:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539008 00000100:00100000:2.0:1790772462.704437:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539136 00000100:00100000:2.0:1790772462.704441:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539136 00000100:00100000:2.0:1790772462.704460:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772462.704468:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2353:x1877760796539008:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:2.0:1790772462.704499:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1590 00000100:00080000:2.0:1790772462.704507:0:6704:0:(import.c:65:import_set_state_nolock()) ffff93288f0e3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790772462.704543:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790772462.704870:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+2:2353:x1877760796539008:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 402us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772462.704921:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772462.705004:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1790772462.705012:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2353:x1877760796539136:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:2.0:1790772462.705024:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1597 00000100:00080000:2.0:1790772462.705029:0:6704:0:(import.c:65:import_set_state_nolock()) ffff93288f0e0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790772462.705047:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790772462.705223:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+2:2353:x1877760796539136:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 212us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772462.705230:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:2.0:1790772462.705247:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790772462.705508:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772462.705513:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772462.705728:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772462.715382:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772462.715421:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772462.715458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772462.715642:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538880 00000100:00100000:3.0:1790772462.715653:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538880 00000100:00100000:3.0:1790772462.715732:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538752 00000100:00100000:3.0:1790772462.715736:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538752 00000100:00100000:3.0:1790772462.715759:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:3.0:1790772462.715769:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2354:x1877760796538880:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772462.715842:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2354:x1877760796538880:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 74us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772462.715863:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:3.0:1790772462.715924:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:3.0:1790772462.715931:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796538752:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772462.715967:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796538752:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772462.715973:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:1.0:1790772462.716541:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796538624 00000100:00100000:1.0:1790772462.716546:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796538624 00000100:00100000:1.0:1790772462.716581:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:1.0:1790772462.716588:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796538624:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772462.716627:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796538624:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772462.716633:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00080000:2.0:1790772462.718352:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772462.795925:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772462.796016:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813351424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772462.796091:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772462.796246:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351424 00000100:00100000:0.0:1790772462.796255:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351424 00000100:00100000:0.0:1790772462.796303:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790772462.796324:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813351424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772462.799653:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772462.799775:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813351424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3450us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772462.799786:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790772462.800275:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1190000 x1877760813351424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772462.800299:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813351424:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1790772462.919377:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4553db9-253c-4dc5-b7ca-58baa04a749a 00000020:00000080:1.0:1790772462.919398:0:6730:0:(genops.c:885:class_export_put()) final put ffff93288f0e5000/a4553db9-253c-4dc5-b7ca-58baa04a749a 00000020:00000080:1.0:1790772462.919428:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f0e5000/a4553db9-253c-4dc5-b7ca-58baa04a749a for lustre-OST0000 00000020:00000080:1.0:1790772462.919484:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f0e3000 for lustre-OST0000 00010000:00010000:2.0:1790772463.376784:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790772463.441858:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4553db9-253c-4dc5-b7ca-58baa04a749a 00000020:00000080:2.0:1790772463.441867:0:7658:0:(genops.c:885:class_export_put()) final put ffff93288f0e5800/a4553db9-253c-4dc5-b7ca-58baa04a749a 00000020:00000080:3.0:1790772463.442009:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f0e5800/a4553db9-253c-4dc5-b7ca-58baa04a749a for lustre-OST0001 00000020:00000080:3.0:1790772463.442059:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f0e0000 for lustre-OST0001 00010000:00010000:2.0:1790772464.395952:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772465.310722:0:11034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790772465.419027:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772465.867284:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813351552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772465.867373:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772465.867695:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351552 00000100:00100000:3.0:1790772465.867704:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351552 00000100:00100000:3.0:1790772465.867776:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790772465.867786:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813351552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772465.867821:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772465.867920:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813351552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772465.867928:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1790772465.868168:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790772465.868202:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1190000 x1877760813351552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772465.868223:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813351552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790772466.444174:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772467.411136:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772467.411159:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813351680:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411231:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772467.411318:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813351808:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411349:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772467.411385:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351808 00000100:00100000:0.0:1790772467.411393:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351808 00000100:00100000:0.0:1790772467.411445:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772467.411455:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813351808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411513:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813351808:12345-0@lo:400:kworker.0 Request processed in 59us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772467.411520:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772467.411563:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813351808:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411608:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813351936:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411633:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772467.411662:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351936 00000100:00100000:0.0:1790772467.411666:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351936 00000100:00100000:0.0:1790772467.411704:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790772467.411711:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813351936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411745:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813351936:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772467.411751:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790772467.411778:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813351936:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411805:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772467.411822:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813352064:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411849:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772467.411909:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772467.411916:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813352192:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.411938:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772467.411967:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352192 00000100:00100000:0.0:1790772467.411970:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352192 00000100:00100000:0.0:1790772467.411991:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790772467.411997:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813352192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.412028:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813352192:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772467.412034:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790772467.412058:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813352192:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.412087:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813352320:0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.412109:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772467.412136:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352064 00000100:00100000:0.0:1790772467.412139:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352064 00000100:00100000:0.0:1790772467.412163:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352320 00000100:00100000:0.0:1790772467.412166:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352320 00000100:00100000:0.0:1790772467.412182:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790772467.412188:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813352064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.412223:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813352064:12345-0@lo:400:kworker.0 Request processed in 35us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772467.412229:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790772467.412239:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790772467.412245:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813352320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772467.412273:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813352320:12345-0@lo:400:kworker.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772467.412278:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1790772467.412306:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb03480 x1877760813352064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772467.412328:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813352064:0@lo:400:kworker.0 00010000:00080000:0.0:1790772467.412349:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfb00380 x1877760813352320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772467.412357:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813352320:0@lo:400:kworker.0 00000100:00100000:2.0:1790772467.414252:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813351680 00000100:00080000:3.0:1790772467.415085:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772467.415096:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772467.415099:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772467.415193:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813351680 00000100:00100000:2.0:1790772467.415303:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790772467.415429:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813351680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772467.415635:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813351680:12345-0@lo:400:kworker.0 Request processed in 324us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772467.415644:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790772467.422961:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813351680:0@lo:400:kworker.0 00010000:00010000:0.0:1790772467.469945:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772467.825296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772467.825358:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772467.825390:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772467.825429:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539520 00000100:00100000:0.0:1790772467.825558:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539520 00000100:00100000:0.0:1790772467.825644:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539392 00000100:00100000:0.0:1790772467.825649:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539392 00000100:00100000:0.0:1790772467.825689:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1790772467.825703:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796539520:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772467.825815:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796539520:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 103us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772467.825824:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1790772467.825847:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1790772467.825855:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796539392:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772467.825929:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796539392:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 74us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772467.825934:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539264 00000100:00100000:0.0:1790772467.825937:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:1.0:1790772467.825953:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539264 00000100:00100000:1.0:1790772467.826019:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:1.0:1790772467.826029:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796539264:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772467.826103:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796539264:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772467.826111:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00080000:3.0:1790772467.828008:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772467.916329:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813352448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772467.916415:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772467.916491:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352448 00000100:00100000:2.0:1790772467.916500:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352448 00000100:00100000:2.0:1790772467.916544:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790772467.916553:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813352448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772467.916593:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772467.916639:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813352448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772467.916647:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1790772467.916704:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1197100 x1877760813352448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772467.916737:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813352448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772468.497330:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790772468.888576:0:11182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3675c260 20000000:00000080:3.0:1790772468.888594:0:11182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9328b9b88c00 uarg=0000000000000000 20000000:01000000:3.0:1790772468.888628:0:11182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790772468.888633:0:11182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790772468.888643:0:11182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790772468.889700:0:11183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790772468.890046:0:11182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790772468.895632:0:11182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790772468.895674:0:11182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895696:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895706:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be154a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895714:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1558 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895722:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be1566 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895730:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895740:0:11182:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895806:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.895824:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 12 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.895849:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352576:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772468.896211:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1566 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.896220:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1566 expref: 18 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.896229:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352704:0@lo:104: 00000100:00100000:3.0:1790772468.896270:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772468.896314:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be1558 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.896322:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be1558 expref: 18 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.896330:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888344380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352832:0@lo:104: 00000100:00100000:3.0:1790772468.896352:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772468.896373:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be154a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.896381:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be154a expref: 18 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.896388:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352960:0@lo:104: 00000100:00100000:3.0:1790772468.896407:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772468.896423:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.896431:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 12 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.896454:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813353088:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772468.896479:0:11182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772468.896804:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352704 00000100:00100000:2.0:1790772468.896813:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352704 00000100:00100000:2.0:1790772468.896859:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352832 00000100:00100000:2.0:1790772468.896861:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352832 00000100:00100000:2.0:1790772468.896870:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813352960 00000100:00100000:2.0:1790772468.896902:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813352960 00000100:00100000:2.0:1790772468.896919:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772468.896928:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+5:11182:x1877760813352704:12345-0@lo:104: 00010000:00010000:2.0:1790772468.896942:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897014:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772468.897021:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+5:11182:x1877760813352704:12345-0@lo:104: Request processed in 93us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.897028:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772468.897045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772468.897050:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+4:11182:x1877760813352832:12345-0@lo:104: 00010000:00010000:2.0:1790772468.897057:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897088:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790772468.897093:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+4:11182:x1877760813352832:12345-0@lo:104: Request processed in 44us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.897098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772468.897109:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772468.897114:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:11182:x1877760813352960:12345-0@lo:104: 00010000:00010000:2.0:1790772468.897121:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897162:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790772468.897167:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+3:11182:x1877760813352960:12345-0@lo:104: Request processed in 53us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.897173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1790772468.897193:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790772468.897198:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897205:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfe00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772468.897215:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897223:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772468.897230:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772468.897235:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772468.897263:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897269:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772468.897289:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897296:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bfe00/0xd3c7635991be1566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be156d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897309:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772468.897311:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897316:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8400 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772468.897319:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897326:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772468.897342:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772468.897347:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772468.897361:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897367:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772468.897383:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897389:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8400/0xd3c7635991be1558 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be155f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897403:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772468.897406:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897411:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519000 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772468.897414:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897420:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772468.897426:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772468.897431:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772468.897448:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897455:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772468.897461:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897467:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881519000/0xd3c7635991be154a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be1551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897479:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772468.897481:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772468.897483:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772468.897495:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813353216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772468.897525:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772468.897564:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813353344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772468.897586:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772468.897603:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772468.897608:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813353472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772468.897626:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772468.897653:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353216 00000100:00100000:2.0:1790772468.897657:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353216 00010000:00010000:2.0:1790772468.897675:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1566 expref: 19 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772468.897692:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353344 00000100:00100000:2.0:1790772468.897695:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353344 00010000:00010000:2.0:1790772468.897705:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1558 expref: 20 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772468.897726:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353472 00000100:00100000:2.0:1790772468.897729:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353472 00010000:00010000:2.0:1790772468.897739:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be154a expref: 21 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772468.897751:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772468.897757:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+21:3318:x1877760813353216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772468.897769:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772468.897774:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1566 expref: 21 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897797:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1566 expref: 21 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897815:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772468.897843:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+21:3318:x1877760813353216:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.897848:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772468.897927:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772468.897933:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3315:x1877760813353344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772468.897940:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772468.897944:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be1558 expref: 20 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897953:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be1558 expref: 20 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.897962:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772468.897996:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+20:3315:x1877760813353344:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.898003:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772468.898015:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790772468.898021:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813353472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772468.898029:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772468.898033:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be154a expref: 19 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.898042:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be154a expref: 19 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.898051:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772468.898071:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813353472:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.898077:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790772468.898119:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813353216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772468.898144:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813353472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772468.898151:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813353344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772468.898305:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772468.898313:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772468.899382:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12bf400/0xd3c7635991be156d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1566 expref: 18 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.899401:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352704:0@lo:104: 00010000:00010000:3.0:1790772468.899414:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12bfa00/0xd3c7635991be155f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be1558 expref: 17 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.899422:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888344380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352832:0@lo:104: 00010000:00010000:3.0:1790772468.899431:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12be600/0xd3c7635991be1551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be154a expref: 16 pid: 5850 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.899439:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352960:0@lo:104: 00000100:00100000:3.0:1790772468.904041:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1190000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813352576:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772468.904056:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1877760813353088:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772468.904096:0:11182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772468.906274:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772468.906302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772468.906401:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539648 00000100:00100000:2.0:1790772468.906412:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539648 00010000:00010000:2.0:1790772468.906459:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 13 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772468.906485:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539776 00000100:00100000:2.0:1790772468.906487:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539776 00010000:00010000:2.0:1790772468.906497:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 14 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772468.906535:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1790772468.906543:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+14:2354:x1877760796539648:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772468.906561:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772468.906566:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 14 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906579:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 14 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906598:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4db000/0xd3c7635991be1582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507d0 expref: 14 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906614:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772468.906662:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796539648:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 119us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.906670:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1790772468.906687:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1790772468.906693:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:2354:x1877760796539776:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772468.906701:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772468.906705:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 12 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906714:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 12 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906724:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881518a00/0xd3c7635991be1543 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50798 expref: 12 pid: 5848 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906742:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906750:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906765:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906772:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906779:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906799:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906805:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8e00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772468.906809:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906818:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906833:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772468.906843:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772468.906860:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2354:x1877760796539776:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 167us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772468.906872:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00010000:00010000:3.0:1790772468.907041:0:11182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.907050:0:11182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772468.907067:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be159e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772469.516824:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790772470.091110:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772470.091118:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328bb7d8800 from 7 10000000:01000000:0.0:1790772470.091122:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772470.091178:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.091191:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.091204:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772470.091231:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.091307:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.091379:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772470.091577:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353600 00000100:00100000:1.0:1790772470.091587:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353600 00000100:00100000:1.0:1790772470.091642:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790772470.091651:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813353600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772470.091665:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772470.091678:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be15a5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.091703:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.091715:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.091725:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772470.091787:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813353600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772470.091974:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772470.091991:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.092001:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772470.092052:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.092079:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.092109:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772470.092174:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353728 00000100:00100000:2.0:1790772470.092179:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353728 00000100:00100000:2.0:1790772470.092211:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790772470.092218:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813353728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772470.092466:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813353728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772470.092473:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790772470.092663:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790772470.093079:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.093115:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.093159:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.093186:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772470.093246:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353856 00000100:00100000:2.0:1790772470.093250:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353856 00000100:00100000:2.0:1790772470.093282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790772470.093289:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813353856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772470.093451:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813353856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772470.093457:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790772470.093576:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790772470.104160:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790772470.105118:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790772470.105146:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772470.105160:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.105172:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772470.105184:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772470.105187:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328ba5e9800 from 7 10000000:01000000:0.0:1790772470.105191:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772470.105237:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.105246:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.105258:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772470.105287:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.105370:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.105422:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772470.109211:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813353984 00000100:00100000:3.0:1790772470.109229:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813353984 00000100:00100000:3.0:1790772470.109308:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790772470.109318:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813353984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772470.109337:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772470.109355:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be15b3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772470.109383:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772470.109395:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772470.109404:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9200, rc 0) 00000100:00100000:3.0:1790772470.109476:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813353984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772470.109483:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790772470.109673:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813353984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772470.109693:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.109702:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772470.109791:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.109825:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.109861:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772470.109949:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354112 00000100:00100000:3.0:1790772470.109954:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354112 00000100:00100000:3.0:1790772470.109985:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790772470.109993:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813354112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772470.110238:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813354112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772470.110252:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790772470.110637:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.110670:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.110712:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.110745:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772470.110815:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354240 00000100:00100000:3.0:1790772470.110820:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354240 00000100:00100000:3.0:1790772470.110852:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790772470.110859:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813354240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772470.111026:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813354240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772470.111033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790772470.111154:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772470.111988:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790772470.115991:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790772470.116028:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772470.116041:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772470.116054:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772470.116066:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790772470.116068:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891b62000 from 7 10000000:01000000:3.0:1790772470.116071:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772470.116113:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772470.116121:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772470.116132:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772470.116160:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772470.116244:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772470.116289:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf5c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772470.121177:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354368 00000100:00100000:0.0:1790772470.121193:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354368 00000100:00100000:0.0:1790772470.121257:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790772470.121268:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813354368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772470.121289:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772470.121310:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be15c1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.121340:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.121351:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.121361:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be800, rc 0) 00000100:00100000:0.0:1790772470.121442:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813354368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772470.121456:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790772470.121510:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772470.121531:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.121540:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772470.121610:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.121641:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.121671:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772470.121685:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354496 00000100:00100000:0.0:1790772470.121688:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354496 00000100:00100000:0.0:1790772470.121711:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790772470.121716:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813354496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.122013:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813354496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772470.122021:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790772470.122056:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.122085:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.122124:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772470.122138:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9894180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772470.122149:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354624 00000100:00100000:0.0:1790772470.122152:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354624 00000100:00100000:0.0:1790772470.122172:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790772470.122184:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813354624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772470.122325:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813354624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772470.122331:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790772470.122365:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813354624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772470.123013:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790772470.123067:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790772470.123082:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772470.123090:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.123100:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772470.553493:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772470.575850:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772470.575989:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796539904 00000100:00100000:1.0:1790772470.576000:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796539904 00000100:00100000:1.0:1790772470.576062:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00100000:1.0:1790772470.576075:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:5597:x1877760796539904:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772470.576097:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772470.576120:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a507fa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.576151:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.576164:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.576173:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db200, rc 0) 00000100:00100000:1.0:1790772470.576244:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796539904:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 172us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772470.576252:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00100000:1.0:1790772470.580996:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772470.581115:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540032 00000100:00100000:2.0:1790772470.581127:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540032 00000100:00100000:2.0:1790772470.581169:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 242 00000100:00100000:2.0:1790772470.581179:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796540032:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772470.581445:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796540032:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 267us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772470.581454:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 242 00000100:00100000:2.0:1790772470.587293:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772470.596706:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540160 00000100:00100000:3.0:1790772470.596722:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540160 00000100:00100000:3.0:1790772470.596790:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:3.0:1790772470.596800:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796540160:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772470.597038:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796540160:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 238us (9759us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772470.597046:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:2.0:1790772470.605641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772470.607213:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540288 00000100:00100000:1.0:1790772470.607230:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540288 00000100:00100000:1.0:1790772470.607303:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:1.0:1790772470.607313:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796540288:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772470.607333:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772470.607353:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50801 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.607402:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.607415:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772470.607424:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db600, rc 0) 00000100:00100000:1.0:1790772470.607495:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796540288:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 183us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772470.607503:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:0.0:1790772470.614065:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772470.618306:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540416 00000100:00100000:1.0:1790772470.618327:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540416 00000100:00100000:1.0:1790772470.618428:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:1.0:1790772470.618440:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796540416:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772470.618948:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796540416:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 507us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772470.618959:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:2.0:1790772470.622329:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772470.622496:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540544 00000100:00100000:3.0:1790772470.622508:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540544 00000100:00100000:3.0:1790772470.622577:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:3.0:1790772470.622590:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796540544:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772470.622872:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796540544:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 283us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772470.622895:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:2.0:1790772470.993392:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813354752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772470.993464:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772470.993554:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354752 00000100:00100000:2.0:1790772470.993564:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354752 00000100:00100000:2.0:1790772470.993638:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772470.993648:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813354752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772470.993682:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772470.993725:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813354752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772470.993732:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1790772470.993766:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790772470.996894:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfdbf800 x1877760813354752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772470.996924:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813354752:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790772471.565906:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772472.523125:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813355264:0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523200:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772472.523263:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790772472.523270:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813354880:0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523301:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772472.523325:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813355392:0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523349:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772472.523383:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813355008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523406:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772472.523420:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813355520:0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523437:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772472.523451:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772472.523457:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813355136:0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523475:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772472.523503:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813354880 00000100:00100000:1.0:1790772472.523512:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813354880 00000100:00100000:1.0:1790772472.523556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790772472.523566:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813354880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772472.523633:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813354880:12345-0@lo:400:kworker.0 Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772472.523641:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790772472.523708:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813354880:0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.523907:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355264 00000100:00100000:0.0:1790772472.523913:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355264 00000100:00100000:0.0:1790772472.523963:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355520 00000100:00100000:0.0:1790772472.523966:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355520 00000100:00100000:0.0:1790772472.523980:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790772472.523986:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813355264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524028:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813355264:12345-0@lo:400:kworker.0 Request processed in 41us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772472.524034:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790772472.524047:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790772472.524054:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813355520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524093:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813355520:12345-0@lo:400:kworker.0 Request processed in 41us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772472.524100:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790772472.524118:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355392 00000100:00100000:0.0:1790772472.524122:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355392 00000100:00100000:0.0:1790772472.524143:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355008 00000100:00100000:0.0:1790772472.524146:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355008 00000100:00100000:0.0:1790772472.524156:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355136 00000100:00100000:0.0:1790772472.524158:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355136 00000100:00100000:0.0:1790772472.524172:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790772472.524177:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813355392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524206:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813355392:12345-0@lo:400:kworker.0 Request processed in 29us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772472.524212:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790772472.524223:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790772472.524228:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813355008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524253:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813355008:12345-0@lo:400:kworker.0 Request processed in 25us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772472.524258:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790772472.524269:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790772472.524274:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813355136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524298:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813355136:12345-0@lo:400:kworker.0 Request processed in 24us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772472.524304:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790772472.524353:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813355136:0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524366:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813355008:0@lo:400:kworker.0 00010000:00080000:0.0:1790772472.524387:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cfb80 x1877760813355520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772472.524396:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813355520:0@lo:400:kworker.0 00000100:00100000:0.0:1790772472.524424:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813355392:0@lo:400:kworker.0 00010000:00080000:0.0:1790772472.524435:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328831c4380 x1877760813355264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772472.524444:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813355264:0@lo:400:kworker.0 00000100:00080000:1.0:1790772472.524511:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772472.524516:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772472.524518:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790772472.589993:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772472.943797:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772472.943851:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772472.943902:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772472.943931:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540672 00000100:00100000:2.0:1790772472.943941:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540672 00000100:00100000:2.0:1790772472.943989:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 248 00000100:00100000:2.0:1790772472.943998:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796540672:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772472.944063:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796540672:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772472.944071:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 248 00000100:00100000:2.0:1790772472.944101:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540800 00000100:00100000:2.0:1790772472.944118:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540800 00000100:00100000:2.0:1790772472.944151:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796540928 00000100:00100000:2.0:1790772472.944154:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796540928 00000100:00100000:2.0:1790772472.944172:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:2.0:1790772472.944180:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796540800:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772472.944210:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796540800:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772472.944217:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:2.0:1790772472.944227:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1790772472.944233:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796540928:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772472.944254:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796540928:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772472.944260:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00080000:2.0:1790772472.944344:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772473.038681:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772473.038706:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813355648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772473.038790:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772473.038868:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355648 00000100:00100000:3.0:1790772473.038898:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355648 00000100:00100000:3.0:1790772473.038944:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790772473.038953:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813355648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772473.038993:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772473.039037:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813355648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772473.039055:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1790772473.039442:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888347100 x1877760813355648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772473.039463:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813355648:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790772473.388357:0:11381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790772473.612276:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772474.636158:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772475.669800:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772476.109058:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813355776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772476.109173:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772476.109918:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355776 00000100:00100000:3.0:1790772476.109930:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355776 00000100:00100000:3.0:1790772476.110029:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772476.110043:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813355776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772476.110098:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772476.110375:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813355776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 334us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772476.110385:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790772476.110608:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772476.113609:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932888347100 x1877760813355776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772476.113653:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813355776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772476.693010:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772477.500088:0:11481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:47:56 (1790772476) === 00000100:00100000:0.0:1790772477.643845:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813356288:0@lo:400:kworker.0 00000100:00100000:3.0:1790772477.644058:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813355904:0@lo:400:kworker.0 00000100:00100000:3.0:1790772477.644107:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772477.644166:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813356416:0@lo:400:kworker.0 00000100:00100000:3.0:1790772477.644195:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772477.644246:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813355904 00000100:00100000:3.0:1790772477.644255:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813355904 00000100:00100000:3.0:1790772477.644304:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790772477.644313:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813355904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772477.644372:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813355904:12345-0@lo:400:kworker.0 Request processed in 59us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772477.644391:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790772477.644447:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813355904:0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.644659:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772477.644718:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813356032:0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.644747:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772477.644768:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813356544:0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.644793:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772477.644812:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772477.644818:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813356160:0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.644839:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772477.644871:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356416 00000100:00100000:0.0:1790772477.644905:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356416 00000100:00100000:0.0:1790772477.645045:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356032 00000100:00100000:0.0:1790772477.645049:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356032 00000100:00100000:0.0:1790772477.645064:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356160 00000100:00100000:0.0:1790772477.645067:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356160 00000100:00100000:0.0:1790772477.645093:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790772477.645099:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813356416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.645148:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813356416:12345-0@lo:400:kworker.0 Request processed in 48us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.645155:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790772477.645170:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790772477.645176:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813356032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.645211:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813356032:12345-0@lo:400:kworker.0 Request processed in 35us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.645217:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790772477.645229:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790772477.645236:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813356160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.645264:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813356160:12345-0@lo:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.645270:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790772477.645289:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356288 00000100:00100000:0.0:1790772477.645293:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356288 00000100:00100000:0.0:1790772477.645317:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356544 00000100:00100000:0.0:1790772477.645321:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356544 00000100:00100000:0.0:1790772477.645335:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772477.645342:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813356288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.645379:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813356288:12345-0@lo:400:kworker.0 Request processed in 37us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.645384:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772477.645393:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790772477.645397:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813356544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.645435:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813356544:12345-0@lo:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.645441:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1790772477.645464:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772477.645469:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772477.645505:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813356160:0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.647112:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813356032:0@lo:400:kworker.0 00010000:00080000:0.0:1790772477.647147:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1181880 x1877760813356544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772477.647160:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813356544:0@lo:400:kworker.0 00010000:00080000:0.0:1790772477.647220:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cfb80 x1877760813356288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772477.647231:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813356288:0@lo:400:kworker.0 00000100:00100000:0.0:1790772477.647263:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813356416:0@lo:400:kworker.0 00010000:00010000:3.0:1790772477.707176:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772477.760493:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772477.760543:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772477.760619:0:5864:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796541184 00000100:00100000:1.0:1790772477.760642:0:5864:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796541184 00000100:00100000:1.0:1790772477.760748:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1790772477.760759:0:5864:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:9664:x1877760796541184:12345-192.168.201.34@tcp:700:mkdir.0 00000100:00080000:2.0:1790772477.760835:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772477.760863:0:5864:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:9664:x1877760796541184:12345-192.168.201.34@tcp:700:mkdir.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772477.760892:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1790772477.761234:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796541056 00000100:00100000:0.0:1790772477.761240:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796541056 00000100:00100000:0.0:1790772477.761312:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1790772477.761321:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796541056:12345-192.168.201.34@tcp:41:mkdir.0 00000004:00000024:0.0:1790772477.761366:0:8380:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790772477.761452:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796541056:12345-192.168.201.34@tcp:41:mkdir.0 Request processed in 131us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.761459:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1790772477.764463:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772477.764565:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796541440 00000100:00100000:0.0:1790772477.764596:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796541440 00000100:00100000:0.0:1790772477.764686:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1790772477.764698:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:9664:x1877760796541440:12345-192.168.201.34@tcp:36:mkdir.0 00010000:00010000:0.0:1790772477.764777:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772477.764816:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be14be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50783 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.764842:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:0.0:1790772477.764856:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772477.765698:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.765730:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.765745:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.765763:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.765792:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.765800:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772477.768607:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790772477.768641:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.768717:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.768733:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.768740:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772477.768746:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.768755:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.768774:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772477.768778:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772477.768782:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.768790:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772477.768815:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000090e08dfc reply state 0000000007a99d4a transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772477.768825:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772477.769983:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9664:x1877760796541440:12345-192.168.201.34@tcp:36:mkdir.0 Request processed in 5274us (5523us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790772477.769998:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:2.0:1790772477.775085:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.775110:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.775120:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.775128:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfe00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772477.775134:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.775165:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.775186:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9328946b8800) 00010000:00010000:2.0:1790772477.775190:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772477.775196:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.775203:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be15e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772477.788291:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772477.788487:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796541568 00000100:00100000:0.0:1790772477.788502:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796541568 00000100:00100000:0.0:1790772477.788612:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1790772477.788625:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:9665:x1877760796541568:12345-192.168.201.34@tcp:101:chmod.0 00010000:00010000:0.0:1790772477.788704:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772477.788733:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50808 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.788823:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be15f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.788842:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.788856:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772477.788929:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772477.788933:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772477.788996:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.789026:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be15eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50808 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.789050:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be15f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50808 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.789060:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772477.789063:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772477.789067:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bec00, rc 0) 00000100:00100000:0.0:1790772477.789161:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9665:x1877760796541568:12345-192.168.201.34@tcp:101:chmod.0 Request processed in 538us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.789169:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1790772477.792561:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772477.792683:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796541824 00000100:00100000:2.0:1790772477.792698:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796541824 00000100:00100000:2.0:1790772477.792773:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:2.0:1790772477.792785:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9665:x1877760796541824:12345-192.168.201.34@tcp:36:chmod.0 00010000:00010000:2.0:1790772477.792865:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772477.792927:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be15f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50808 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.792967:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772477.792983:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772477.793016:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.793033:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.793044:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772477.793505:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000069b8efbe reply state 0000000060022f7f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772477.793519:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790772477.793531:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790772477.793671:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:9665:x1877760796541824:12345-192.168.201.34@tcp:36:chmod.0 Request processed in 886us (1123us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790772477.793681:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00010000:00010000:0.0:1790772477.798837:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.798868:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.798923:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.798931:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772477.798938:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.798947:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.798969:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803d00) 00010000:00010000:0.0:1790772477.798973:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772477.798978:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.798985:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be15f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772477.809708:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772477.812354:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796541952 00000100:00100000:2.0:1790772477.812376:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796541952 00000100:00100000:2.0:1790772477.812509:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1790772477.812522:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9666:x1877760796541952:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:2.0:1790772477.812567:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772477.812596:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5080f expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.812701:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.812718:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.812730:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772477.812772:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772477.812776:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772477.812822:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.812870:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5080f expref: 9 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.813090:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5080f expref: 8 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.813102:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803f00) 00010000:00010000:2.0:1790772477.813106:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772477.813110:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519800, rc 0) 00000100:00100000:2.0:1790772477.813259:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:9666:x1877760796541952:12345-192.168.201.34@tcp:101:chown.0 Request processed in 738us (3565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772477.813267:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1790772477.821535:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772477.829014:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796542080 00000100:00100000:3.0:1790772477.829038:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796542080 00000100:00100000:3.0:1790772477.829272:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1790772477.829286:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:9666:x1877760796542080:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:3.0:1790772477.829317:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772477.829350:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be160e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50816 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829440:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829460:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829475:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829494:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829502:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829533:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829674:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829683:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829691:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772477.829730:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772477.829734:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772477.829760:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829774:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829782:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829790:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829797:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772477.829803:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829811:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829833:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803f00) 00010000:00010000:3.0:1790772477.829837:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772477.829843:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829850:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829935:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829944:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829959:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829965:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772477.829968:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829974:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829982:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff932884f65700) 00010000:00010000:3.0:1790772477.829984:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772477.829988:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.829993:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be161c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.830047:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be160e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50816 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.830063:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50816 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.830071:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff932884f65b00) 00010000:00010000:3.0:1790772477.830073:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772477.830076:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8000, rc 0) 00000100:00100000:3.0:1790772477.830185:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:9666:x1877760796542080:12345-192.168.201.34@tcp:101:chown.0 Request processed in 901us (8666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772477.830193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1790772477.833164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772477.836353:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796542336 00000100:00100000:0.0:1790772477.836380:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796542336 00000100:00100000:0.0:1790772477.836502:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1790772477.836516:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:9666:x1877760796542336:12345-192.168.201.34@tcp:36:chown.0 00010000:00010000:0.0:1790772477.836604:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772477.836652:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50816 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.836713:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff932884f65b00) 00010000:00010000:0.0:1790772477.836730:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772477.836767:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.836784:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.836795:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772477.889421:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1790772477.889522:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000082d4528b reply state 000000003662ec77 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772477.889540:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790772477.889560:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1790772477.889713:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790772477.889739:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9666:x1877760796542336:12345-192.168.201.34@tcp:36:chown.0 Request processed in 53220us (56584us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790772477.889750:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:3.0:1790772477.892668:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.892705:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.892715:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.892722:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772477.892728:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.892737:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.892758:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:3.0:1790772477.892784:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772477.892790:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772477.892797:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be162a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772477.909456:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772477.909573:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796542464 00000100:00100000:2.0:1790772477.909588:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796542464 00000100:00100000:2.0:1790772477.909682:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1790772477.909696:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:9667:x1877760796542464:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:2.0:1790772477.909733:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772477.909759:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5081d expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772477.917171:0:8380:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7336us 00010000:00010000:0.0:1790772477.935459:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.935489:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.935504:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.935524:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.935532:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.935539:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936206:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be1646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936229:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be1646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936238:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be1646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772477.936269:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772477.936274:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772477.936326:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be1646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936340:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936348:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936355:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936362:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772477.936367:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936375:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936389:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803f00) 00010000:00010000:0.0:1790772477.936392:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772477.936397:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936413:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be1638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936429:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936435:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936442:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936446:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfa00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772477.936449:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936455:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936462:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9328946b8200) 00010000:00010000:0.0:1790772477.936464:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772477.936467:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936472:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be163f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936521:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5081d expref: 8 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936540:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be1646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5081d expref: 7 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.936555:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772477.936558:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772477.936561:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bf400, rc 0) 00000100:00100000:0.0:1790772477.936742:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9667:x1877760796542464:12345-192.168.201.34@tcp:101:touch.500 Request processed in 27047us (27299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772477.936754:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1790772477.940538:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772477.940652:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796542720 00000100:00100000:0.0:1790772477.940665:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796542720 00000100:00100000:0.0:1790772477.940831:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772477.940843:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9667:x1877760796542720:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:0.0:1790772477.940898:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772477.940929:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be164d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50824 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.941360:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.941379:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.941393:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.941411:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.941418:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.941440:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772477.942642:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1790772477.943562:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943582:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943593:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943652:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943661:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943743:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943754:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bec00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772477.943760:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943770:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943786:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772477.943790:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772477.943804:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.943810:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be1654 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772477.943826:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000202d8418 reply state 0000000026e742b1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772477.943836:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772477.944128:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be164d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50824 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.944151:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50824 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.944160:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328946b8900) 00010000:00010000:0.0:1790772477.944162:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772477.944166:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772477.944326:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:9667:x1877760796542720:12345-192.168.201.34@tcp:101:touch.500 Request processed in 3484us (3803us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790772477.944337:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:2.0:1790772477.947077:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.947125:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.947133:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.947140:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfe00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772477.947146:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.947155:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.947175:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9328946b8100) 00010000:00010000:2.0:1790772477.947178:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772477.947183:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772477.947190:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be165b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772477.949816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772477.950559:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796542976 00000100:00100000:1.0:1790772477.950575:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796542976 00000100:00100000:1.0:1790772477.950664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1790772477.950688:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:9667:x1877760796542976:12345-192.168.201.34@tcp:36:touch.500 00010000:00010000:1.0:1790772477.950771:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772477.950809:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50824 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772477.950832:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328946b8900) 00010000:00010000:1.0:1790772477.950865:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772477.951174:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772477.951194:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772477.951207:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772477.951379:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007cf6bfd5 reply state 000000000c79e655 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772477.951391:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772477.951521:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:9667:x1877760796542976:12345-192.168.201.34@tcp:36:touch.500 Request processed in 835us (1718us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790772477.951531:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1790772477.954437:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:0.0:1790772477.954545:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.954560:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.954569:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.954600:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772477.954606:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.954615:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.954645:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328a16c3400) 00010000:00010000:0.0:1790772477.954649:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772477.954654:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772477.954661:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1670 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772477.955241:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796543104 00000100:00100000:1.0:1790772477.955256:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796543104 00000100:00100000:1.0:1790772477.955323:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1790772477.955335:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:9667:x1877760796543104:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:1.0:1790772477.955369:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772477.955394:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be1677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5082b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772477.955471:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be1677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5082b expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772477.955488:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be1677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5082b expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772477.955530:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:1.0:1790772477.955533:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772477.955536:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4daa00, rc 0) 00000100:00100000:1.0:1790772477.955712:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:9667:x1877760796543104:12345-192.168.201.34@tcp:101:touch.500 Request processed in 379us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772477.955720:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1790772477.959550:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772477.959724:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796543232 00000100:00100000:2.0:1790772477.959738:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796543232 00000100:00100000:2.0:1790772477.959825:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1790772477.959836:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877760796543232:12345-192.168.201.34@tcp:8:touch.500 00010000:00080000:2.0:1790772477.959901:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:2.0:1790772477.959942:0:6705:0:(genops.c:1384:class_connect()) connect: client 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677, cookie 0xd3c7635991be167e 00002000:00100000:2.0:1790772477.959957:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677/ffff93288f0e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790772477.960072:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790772477.960382:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772477.960420:0:6705:0:(import.c:65:import_set_state_nolock()) ffff93288f0e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772477.960518:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2353:x1877760796543232:12345-192.168.201.34@tcp:8:touch.500 Request processed in 682us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772477.960527:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1790772477.962845:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772477.962956:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796543360 00000100:00100000:3.0:1790772477.962968:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796543360 00000100:00080000:0.0:1790772477.963170:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772477.963213:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772477.963226:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:0:x1877760796543360:12345-192.168.201.34@tcp:2:touch.500 00000001:00100000:2.0:1790772477.990973:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000001:00080000:2.0:1790772477.990999:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1790772477.991144:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:0:x1877760796543360:12345-192.168.201.34@tcp:2:touch.500 Request processed in 27914us (28306us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790772477.991155:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772477.993128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772477.993210:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796543616 00000100:00100000:0.0:1790772477.993221:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796543616 00000100:00100000:0.0:1790772477.993304:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1790772477.993313:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:9667:x1877760796543616:12345-192.168.201.34@tcp:35:touch.500 00000100:00100000:0.0:1790772477.993745:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:9667:x1877760796543616:12345-192.168.201.34@tcp:35:touch.500 Request processed in 430us (624us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790772477.993755:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1790772478.003268:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772478.003381:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796543744 00000100:00100000:2.0:1790772478.003394:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796543744 00000100:00100000:2.0:1790772478.003503:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1790772478.003516:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:9668:x1877760796543744:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1790772478.003550:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772478.003578:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50832 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.003700:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be168c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.003719:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be168c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.003733:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be168c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772478.003784:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772478.003790:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772478.003843:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be168c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.004140:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50832 expref: 13 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.004166:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be168c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50832 expref: 12 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.004176:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:2.0:1790772478.004180:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772478.004184:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519200, rc 0) 00000100:00100000:2.0:1790772478.004275:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:9668:x1877760796543744:12345-192.168.201.34@tcp:101:rm.0 Request processed in 762us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772478.004284:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1790772478.008932:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772478.009038:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796544000 00000100:00100000:2.0:1790772478.009055:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796544000 00000100:00100000:2.0:1790772478.009131:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1790772478.009141:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:9668:x1877760796544000:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1790772478.009167:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772478.009193:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518c00/0xd3c7635991be1693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50839 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772478.009302:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772478.009495:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518c00/0xd3c7635991be1693 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50839 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.009513:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803f00) 00010000:00010000:2.0:1790772478.009517:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772478.009530:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518c00/0xd3c7635991be1693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50839 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.009549:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518c00, rc 0) 00000100:00100000:2.0:1790772478.009645:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:9668:x1877760796544000:12345-192.168.201.34@tcp:101:rm.0 Request processed in 505us (729us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790772478.009653:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1790772478.013293:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772478.013372:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796544128 00000100:00100000:1.0:1790772478.013385:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796544128 00000100:00100000:1.0:1790772478.013458:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1790772478.013469:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:9668:x1877760796544128:12345-192.168.201.34@tcp:37:rm.0 00000100:00100000:1.0:1790772478.022804:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:9668:x1877760796544128:12345-192.168.201.34@tcp:37:rm.0 Request processed in 9319us (9505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772478.022823:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1790772478.026780:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772478.027212:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796544384 00000100:00100000:0.0:1790772478.027226:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796544384 00000100:00100000:0.0:1790772478.027322:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1790772478.027334:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:9668:x1877760796544384:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:0.0:1790772478.027781:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:9668:x1877760796544384:12345-192.168.201.34@tcp:35:rm.0 Request processed in 447us (1012us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790772478.027791:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1790772478.031283:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772478.031389:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796544640 00000100:00100000:1.0:1790772478.031402:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796544640 00000100:00100000:1.0:1790772478.031520:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1790772478.031532:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:9668:x1877760796544640:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:1.0:1790772478.031566:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772478.031596:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50840 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.031765:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be16a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.031789:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be16a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.031824:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be16a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772478.031840:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790772478.032245:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50840 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.032269:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be16a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50840 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.032279:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:1.0:1790772478.032282:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772478.032286:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dae00, rc 0) 00000100:00100000:1.0:1790772478.032433:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796544640:12345-192.168.201.34@tcp:101:rm.0 Request processed in 903us (1164us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790772478.032441:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1790772478.035988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772478.036155:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796544768 00000100:00100000:1.0:1790772478.036170:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796544768 00000100:00100000:1.0:1790772478.036245:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1790772478.036257:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796544768:12345-192.168.201.34@tcp:41:rm.0 00000004:00000024:1.0:1790772478.036345:0:5856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790772478.036440:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796544768:12345-192.168.201.34@tcp:41:rm.0 Request processed in 184us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772478.036449:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1790772478.039161:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772478.039244:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796544896 00000100:00100000:2.0:1790772478.039257:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796544896 00000100:00100000:2.0:1790772478.039326:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1790772478.039338:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796544896:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1790772478.039365:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772478.039393:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be16b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50847 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039479:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039498:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039510:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039528:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039537:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039543:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039708:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039717:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039724:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772478.039758:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790772478.039762:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772478.039785:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039798:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039807:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039815:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039822:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039830:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772478.039835:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039844:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039867:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:2.0:1790772478.039870:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772478.039915:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039924:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be16bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039940:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039947:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039954:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039960:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772478.039963:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039970:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.039978:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9328a1803e00) 00010000:00010000:2.0:1790772478.039980:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772478.039983:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.040002:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be16c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.040053:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be16b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50847 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.040069:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50847 expref: 17 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.040078:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:2.0:1790772478.040080:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772478.040084:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518a00, rc 0) 00000100:00100000:2.0:1790772478.040158:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:9668:x1877760796544896:12345-192.168.201.34@tcp:101:rm.0 Request processed in 822us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772478.040166:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:3.0:1790772478.044048:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772478.044288:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796545152 00000100:00100000:1.0:1790772478.044302:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796545152 00000100:00100000:1.0:1790772478.044394:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1790772478.044406:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:9668:x1877760796545152:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:1.0:1790772478.044481:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790772478.044515:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be16cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50847 expref: 17 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044542:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be1677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5082b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044555:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:1.0:1790772478.044575:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be168c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50832 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044583:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:1.0:1790772478.044587:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772478.044611:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044646:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044658:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044686:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044694:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.044712:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.045100:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.045110:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772478.045119:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772478.051138:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1790772478.051172:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298871295867ns, next at 299871288975ns, rc = 0 00010000:00010000:0.0:1790772478.051308:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051332:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051348:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051359:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051368:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051375:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051405:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772478.051437:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051445:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051469:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051476:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772478.051482:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051491:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051507:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328a16c3f00) 00010000:00010000:0.0:1790772478.051510:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790772478.051516:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051523:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be16e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051545:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051552:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051558:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051563:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772478.051566:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051582:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051591:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772478.051593:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772478.051596:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.051601:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be16d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772478.051612:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099dbc738 reply state 00000000882e72e7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772478.051632:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772478.051944:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796545152:12345-192.168.201.34@tcp:36:rm.0 Request processed in 7533us (7902us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790772478.051957:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00010000:00010000:3.0:1790772478.052134:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772478.052143:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.052150:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772478.052154:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.052160:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.052179:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9328a16c3f00) 00010000:00010000:3.0:1790772478.052182:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790772478.052185:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.052191:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92800/0xd3c7635991be16e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.052209:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772478.052211:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772478.052212:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772478.055836:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.055861:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.055870:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.055928:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772478.055935:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.055944:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.055966:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9328a16c3400) 00010000:00010000:2.0:1790772478.055997:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772478.056004:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772478.056012:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be16d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772478.057076:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772478.057479:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796545408 00000100:00100000:0.0:1790772478.057492:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796545408 00000100:00100000:0.0:1790772478.057555:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1790772478.057567:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:9668:x1877760796545408:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:0.0:1790772478.057971:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796545408:12345-192.168.201.34@tcp:35:rm.0 Request processed in 404us (904us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790772478.057980:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1790772478.060593:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772478.060945:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796545664 00000100:00100000:3.0:1790772478.060958:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796545664 00000100:00100000:3.0:1790772478.061175:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1790772478.061187:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:9668:x1877760796545664:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:3.0:1790772478.061261:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790772478.061297:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be16a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50840 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061322:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be1646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5081d expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061334:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:3.0:1790772478.061353:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5080f expref: 14 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061364:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803f00) 00010000:00010000:3.0:1790772478.061388:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772478.061419:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061435:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061447:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061461:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061468:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061475:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061792:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061803:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.061810:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772478.062502:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790772478.062528:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062539:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062553:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062560:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772478.062566:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062576:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062590:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff932884f65f00) 00010000:00010000:3.0:1790772478.062593:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790772478.062597:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062604:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be16fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062640:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062647:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062654:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062659:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772478.062662:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062679:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062687:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65700) 00010000:00010000:3.0:1790772478.062690:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772478.062693:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772478.062698:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be16ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772478.062711:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d386929d reply state 00000000467ab240 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772478.062722:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772478.062842:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:9668:x1877760796545664:12345-192.168.201.34@tcp:36:rm.0 Request processed in 1651us (2257us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790772478.062853:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1790772478.076297:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772478.076348:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772478.076396:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772478.076452:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546048 00000100:00100000:2.0:1790772478.076466:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546048 00000100:00100000:2.0:1790772478.076546:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:2.0:1790772478.076558:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796546048:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772478.076806:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796545920 00000100:00100000:1.0:1790772478.076811:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796545920 00000100:00100000:1.0:1790772478.076850:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1790772478.076859:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796545920:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772478.076977:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796546048:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 421us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772478.076987:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00080000:2.0:1790772478.077025:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772478.077084:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796545792 00000100:00100000:3.0:1790772478.077090:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796545792 00000100:00100000:3.0:1790772478.077127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00100000:3.0:1790772478.077136:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796545792:12345-192.168.201.34@tcp:400:kworker.0 00010000:00010000:0.0:1790772478.077379:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.077416:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.077426:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.077434:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772478.077440:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.077450:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.077470:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff932884f65800) 00010000:00010000:0.0:1790772478.077474:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772478.077480:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772478.077488:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be16f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772478.085089:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796545920:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 8211us (8791us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772478.085109:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1790772478.088406:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796545792:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 11254us (12040us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772478.088428:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00100000:1.0:1790772478.155495:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772478.155533:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813356672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772478.155693:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772478.156178:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356672 00000100:00100000:2.0:1790772478.156190:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356672 00000100:00100000:2.0:1790772478.156313:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790772478.156325:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813356672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772478.157079:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772478.157896:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813356672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1545us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772478.157909:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1790772478.162848:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c100aa00 x1877760813356672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772478.162936:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813356672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772478.731394:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772479.760649:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772480.779245:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772481.229159:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813356800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772481.229260:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772481.229423:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356800 00000100:00100000:1.0:1790772481.229433:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356800 00000100:00100000:1.0:1790772481.229545:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790772481.229557:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813356800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772481.229773:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772481.229833:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813356800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 279us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772481.229842:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790772481.229963:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790772481.230005:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328b8d68380 x1877760813356800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772481.230041:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813356800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772481.812745:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772482.179683:0:11631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1790772482.764511:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813357312:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.764650:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772482.764731:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790772482.764738:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813356928:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.764774:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772482.764798:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813357440:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.764825:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772482.764864:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813357056:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.764933:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772482.764953:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813357568:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.764975:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772482.765180:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772482.765187:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813357184:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.765214:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772482.765256:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357312 00000100:00100000:3.0:1790772482.765267:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357312 00000100:00100000:3.0:1790772482.765323:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357568 00000100:00100000:3.0:1790772482.765328:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357568 00000100:00100000:3.0:1790772482.765358:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790772482.765368:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813357312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.765436:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813357312:12345-0@lo:400:kworker.0 Request processed in 68us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772482.765444:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790772482.765463:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790772482.765469:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813357568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.765502:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813357568:12345-0@lo:400:kworker.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772482.765524:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790772482.765555:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813356928 00000100:00100000:3.0:1790772482.765559:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813356928 00000100:00100000:3.0:1790772482.765817:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1790772482.765827:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813356928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.765864:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813356928:12345-0@lo:400:kworker.0 Request processed in 40us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772482.765871:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1790772482.765947:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357440 00000100:00100000:3.0:1790772482.765951:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357440 00000100:00100000:3.0:1790772482.765995:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357056 00000100:00100000:3.0:1790772482.765999:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357056 00000100:00100000:3.0:1790772482.766010:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357184 00000100:00100000:3.0:1790772482.766012:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357184 00000100:00100000:3.0:1790772482.766025:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772482.766030:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813357440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.766063:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813357440:12345-0@lo:400:kworker.0 Request processed in 34us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772482.766068:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772482.766080:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790772482.766085:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813357056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.766111:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813357056:12345-0@lo:400:kworker.0 Request processed in 26us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772482.766116:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790772482.766127:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790772482.766132:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813357184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.766169:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813357184:12345-0@lo:400:kworker.0 Request processed in 37us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772482.766175:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1790772482.766202:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772482.766207:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772482.766248:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813357184:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.766261:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813357056:0@lo:400:kworker.0 00010000:00080000:3.0:1790772482.766275:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c100b480 x1877760813357568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772482.766285:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813357568:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.766322:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813356928:0@lo:400:kworker.0 00000100:00100000:3.0:1790772482.766332:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813357440:0@lo:400:kworker.0 00010000:00080000:3.0:1790772482.766345:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c1008700 x1877760813357312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772482.766354:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813357312:0@lo:400:kworker.0 00010000:00010000:0.0:1790772482.834257:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772483.191529:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772483.191597:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772483.191629:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772483.191657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772483.191687:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546304 00000100:00100000:2.0:1790772483.191697:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546304 00000100:00100000:2.0:1790772483.191750:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546560 00000100:00100000:2.0:1790772483.191753:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546560 00000100:00100000:2.0:1790772483.191772:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:2.0:1790772483.191781:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2355:x1877760796546304:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772483.191867:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2355:x1877760796546304:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772483.192101:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:2.0:1790772483.192123:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:2.0:1790772483.192130:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796546560:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772483.192158:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796546560:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772483.192165:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:2.0:1790772483.192187:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546176 00000100:00100000:2.0:1790772483.192191:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546176 00000100:00100000:2.0:1790772483.192217:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 252 00000100:00100000:2.0:1790772483.192223:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796546176:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772483.192247:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796546176:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772483.192253:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 252 00000100:00100000:2.0:1790772483.192279:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546432 00000100:00100000:2.0:1790772483.192282:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546432 00000100:00100000:2.0:1790772483.192329:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1790772483.192335:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796546432:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772483.192362:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796546432:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772483.192368:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00080000:2.0:1790772483.192383:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772483.192388:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1790772483.279148:0:8023:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304099270786ns, next at 305099268404ns, rc = 0 00000100:00100000:3.0:1790772483.279564:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772483.279640:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772483.279726:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357696 00000100:00100000:3.0:1790772483.279734:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357696 00000100:00100000:3.0:1790772483.279777:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790772483.279787:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813357696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772483.279822:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772483.279870:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813357696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772483.280161:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1790772483.280203:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f34ce00 x1877760813357696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772483.280224:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813357696:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1790772483.431389:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1790772483.435704:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790772483.435962:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1790772483.435988:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813357824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790772483.436058:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772483.436269:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813357824 00000100:00100000:1.0:1790772483.436277:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813357824 00000100:00100000:1.0:1790772483.436330:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790772483.436340:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813357824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790772483.436366:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1790772483.436397:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abd04fe, atime: 0x6abd04fe, ctime: 0x6abd04fe, blocks: 0x1 00010000:00010000:1.0:1790772483.436405:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772483.436421:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1790772483.436426:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772483.436433:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772483.436450:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772483.436460:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772483.436468:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772483.436502:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772483.436709:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772483.436718:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.436729:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772483.436734:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.436746:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.436768:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.436777:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e863935/0xd3c7635991be1703 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.436812:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772483.436815:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772483.436817:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772483.437238:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813357824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 897us (1177us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790772483.437248:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1790772483.437372:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328b8d69500/2, rc 0, transno 4294967300 00000100:00100000:3.0:1790772483.437378:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813357824:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1790772483.456256:0:11681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb6249b80 20000000:00000080:0.0:1790772483.456277:0:11681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9328bf53b000 uarg=0000000000000000 20000000:01000000:0.0:1790772483.456502:0:11681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790772483.456508:0:11681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790772483.456514:0:11681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790772483.466150:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1790772483.466806:0:11681:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790772483.477698:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790772483.477760:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790772483.477820:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790772483.477837:0:11681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790772483.477857:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.477900:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.477910:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.477918:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.477928:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.477937:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.477957:0:11681:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.478011:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.478028:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 12 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772483.478045:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813357952:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772483.478170:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.478179:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772483.478189:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358080:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772483.478216:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.478223:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 18 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772483.478232:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358208:0@lo:104: 00000100:00100000:2.0:1790772483.478267:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772483.478306:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.478325:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 18 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772483.478334:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358336:0@lo:104: 00000100:00100000:2.0:1790772483.478355:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772483.478375:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772483.478382:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 18 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772483.478390:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358464:0@lo:104: 00000100:00100000:2.0:1790772483.478409:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772483.478418:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f39a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772483.478454:0:5838:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790772483.478470:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358208 00000100:00100000:0.0:1790772483.478477:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358208 00000100:00100000:0.0:1790772483.478513:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358336 00000100:00100000:0.0:1790772483.478516:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358336 00000100:00100000:0.0:1790772483.478526:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358464 00000100:00100000:0.0:1790772483.478542:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358464 00000100:00100000:0.0:1790772483.478558:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772483.478566:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:11681:x1877760813358208:12345-0@lo:104: 00010000:00010000:0.0:1790772483.478591:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.478656:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772483.478662:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+5:11681:x1877760813358208:12345-0@lo:104: Request processed in 97us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772483.478669:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772483.478687:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772483.478693:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+4:11681:x1877760813358336:12345-0@lo:104: 00010000:00010000:0.0:1790772483.478701:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.478745:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790772483.478751:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+4:11681:x1877760813358336:12345-0@lo:104: Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772483.478758:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772483.478773:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772483.478779:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b14f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:11681:x1877760813358464:12345-0@lo:104: 00010000:00010000:0.0:1790772483.478786:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.478816:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790772483.478820:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b14f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+3:11681:x1877760813358464:12345-0@lo:104: Request processed in 43us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772483.478826:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1790772483.478862:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790772483.478869:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772483.478911:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358208:0@lo:104: 00000100:00100000:2.0:1790772483.478921:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358336:0@lo:104: 00000100:00100000:2.0:1790772483.478928:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358464:0@lo:104: 00010000:00010000:0.0:1790772483.479130:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9600 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772483.479135:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479144:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772483.479151:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772483.479157:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772483.479203:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479211:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772483.479229:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479235:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9600/0xd3c7635991be15c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15c8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479247:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772483.479250:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479256:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf000 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772483.479259:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479265:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772483.479282:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772483.479286:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772483.479371:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479378:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772483.479390:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479408:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be15b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479417:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772483.479420:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479476:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfc00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772483.479479:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479486:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772483.479492:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772483.479497:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772483.479513:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479518:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772483.479526:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479544:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bfc00/0xd3c7635991be15a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be15ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.479557:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772483.479564:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772483.479566:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772483.479758:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772483.479779:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813358592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772483.479821:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772483.479874:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358592 00000100:00100000:0.0:1790772483.479880:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358592 00010000:00010000:0.0:1790772483.480061:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772483.480091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772483.480134:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813358592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772483.480148:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772483.480154:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.480164:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.480178:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12be800/0xd3c7635991be15c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be15c1 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.480192:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772483.480227:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3318:x1877760813358592:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772483.480233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772483.480287:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813358592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772483.482886:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772483.482925:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813358720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772483.482984:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772483.483031:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772483.483036:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813358848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772483.483054:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772483.483206:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358720 00000100:00100000:0.0:1790772483.483215:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358720 00010000:00010000:0.0:1790772483.483257:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 18 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772483.483295:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358848 00000100:00100000:0.0:1790772483.483298:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358848 00010000:00010000:0.0:1790772483.483376:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772483.483395:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772483.483403:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813358720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772483.483415:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772483.483420:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.483441:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.483457:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be15ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be15b3 expref: 19 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.483471:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772483.483511:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3315:x1877760813358720:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772483.483517:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772483.483544:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772483.483551:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3315:x1877760813358848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772483.483558:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772483.483562:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 17 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.483702:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 17 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.483713:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4da800/0xd3c7635991be15ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be15a5 expref: 17 pid: 5850 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.483721:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772483.483748:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3315:x1877760813358848:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772483.483754:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790772483.485119:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813358848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772483.485132:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813358720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772483.489944:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772483.489974:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772483.490007:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546688 00000100:00100000:3.0:1790772483.490015:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546688 00010000:00010000:3.0:1790772483.490052:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 13 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772483.490083:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546816 00000100:00100000:3.0:1790772483.490086:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546816 00010000:00010000:3.0:1790772483.490097:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 14 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772483.490144:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1790772483.490153:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+14:2354:x1877760796546688:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772483.490168:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772483.490174:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 14 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490186:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 14 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490206:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772483.490257:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+14:2354:x1877760796546688:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 105us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772483.490264:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1790772483.490295:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00010000:00010000:0.0:1790772483.490438:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4db600/0xd3c7635991be15d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50801 expref: 13 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772483.490451:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813357952:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772483.490463:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1877760813358080:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772483.490494:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772483.490746:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:2354:x1877760796546816:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772483.490756:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772483.490761:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490770:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490782:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4db200/0xd3c7635991be15cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507fa expref: 12 pid: 5849 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490793:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490808:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490822:0:8465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490829:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490835:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490841:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490847:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772483.490851:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490859:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490903:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772483.490913:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772483.490935:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2354:x1877760796546816:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 635us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772483.490942:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00010000:00010000:0.0:1790772483.492062:0:11681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.492076:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772483.492082:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881519200/0xd3c7635991be170a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772483.851227:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772484.877850:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772485.105129:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772485.105329:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796546944 00000100:00100000:2.0:1790772485.105341:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796546944 00000100:00100000:2.0:1790772485.105400:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:2.0:1790772485.105411:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:5597:x1877760796546944:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772485.105431:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772485.105453:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932881518c00/0xd3c7635991be1711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5084e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772485.105487:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932881518c00/0xd3c7635991be1711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5084e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772485.105626:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932881518c00/0xd3c7635991be1711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5084e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772485.105635:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518c00, rc 0) 00000100:00100000:2.0:1790772485.105697:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796546944:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 289us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.105705:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:3.0:1790772485.111996:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772485.112232:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547072 00000100:00100000:2.0:1790772485.112244:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547072 00000100:00100000:2.0:1790772485.112305:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:2.0:1790772485.112316:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796547072:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772485.112694:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796547072:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 378us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.112703:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:3.0:1790772485.117909:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772485.118063:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547200 00000100:00100000:2.0:1790772485.118074:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547200 00000100:00100000:2.0:1790772485.118132:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:2.0:1790772485.118297:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796547200:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772485.118649:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796547200:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 507us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.118658:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:3.0:1790772485.129185:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772485.129852:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547328 00000100:00100000:2.0:1790772485.129865:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547328 00000100:00100000:2.0:1790772485.129962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 256 00000100:00100000:2.0:1790772485.129972:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:9938:x1877760796547328:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772485.130257:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:9938:x1877760796547328:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 285us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.130266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 256 00000100:00100000:3.0:1790772485.143974:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772485.144661:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547456 00000100:00100000:2.0:1790772485.144673:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547456 00000100:00100000:2.0:1790772485.144734:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:2.0:1790772485.144744:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:9938:x1877760796547456:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772485.145045:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:9938:x1877760796547456:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 301us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.145055:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:0.0:1790772485.153580:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772485.154756:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547584 00000100:00100000:3.0:1790772485.154774:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547584 00000100:00100000:3.0:1790772485.154851:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:3.0:1790772485.154861:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:5597:x1877760796547584:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772485.154931:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772485.154953:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9800/0xd3c7635991be1718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50855 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.154983:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9800/0xd3c7635991be1718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50855 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.154994:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9800/0xd3c7635991be1718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50855 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.155003:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9800, rc 0) 00000100:00100000:3.0:1790772485.155069:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796547584:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 209us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.155076:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:1.0:1790772485.158536:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772485.159252:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547712 00000100:00100000:3.0:1790772485.159263:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547712 00000100:00100000:3.0:1790772485.159379:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 259 00000100:00100000:3.0:1790772485.159390:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796547712:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.159742:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c75b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796547712:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 353us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.159761:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 259 00000100:00100000:0.0:1790772485.165927:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772485.166062:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547840 00000100:00100000:1.0:1790772485.166074:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547840 00000100:00100000:1.0:1790772485.166405:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 260 00000100:00100000:1.0:1790772485.166417:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796547840:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772485.166695:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289c758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:5597:x1877760796547840:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 279us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772485.166703:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 260 00000100:00100000:0.0:1790772485.170547:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772485.170651:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796547968 00000100:00100000:3.0:1790772485.170663:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796547968 00000100:00100000:3.0:1790772485.170722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:3.0:1790772485.170734:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:9941:x1877760796547968:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772485.171041:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:9941:x1877760796547968:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 309us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.171050:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:0.0:1790772485.176600:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772485.177281:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548096 00000100:00100000:2.0:1790772485.177292:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548096 00000100:00100000:2.0:1790772485.177349:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 262 00000100:00100000:2.0:1790772485.177359:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:9941:x1877760796548096:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772485.177626:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:9941:x1877760796548096:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 268us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.177636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 262 10000000:01000000:0.0:1790772485.196095:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772485.196103:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328bb7d8800 from 7 10000000:01000000:0.0:1790772485.196108:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772485.196170:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772485.196182:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772485.196195:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772485.196221:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813358976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.196294:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772485.196401:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772485.197269:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813358976 00000100:00100000:1.0:1790772485.197278:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813358976 00000100:00100000:1.0:1790772485.197333:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790772485.197342:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:5852:x1877760813358976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772485.197358:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772485.197373:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4daa00/0xd3c7635991be1726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be171f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772485.197396:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4daa00/0xd3c7635991be1726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be171f expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772485.197406:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4daa00/0xd3c7635991be1726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be171f expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772485.197414:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4daa00, rc 0) 00000100:00100000:1.0:1790772485.197465:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813358976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772485.197485:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790772485.197708:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813358976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772485.197725:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772485.197735:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772485.197799:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.197830:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772485.197863:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98940c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.197944:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359104 00000100:00100000:3.0:1790772485.197948:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359104 00000100:00100000:3.0:1790772485.197981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790772485.197989:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813359104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.198245:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813359104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.198252:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790772485.201981:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.202070:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.202175:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772485.202226:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772485.202351:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359232 00000100:00100000:2.0:1790772485.202360:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359232 00000100:00100000:2.0:1790772485.202421:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790772485.202430:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813359232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772485.202633:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813359232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.202639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790772485.203747:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.205622:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11695:1877760813359360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.205690:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.205762:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886db2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772485.206592:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359360 00000100:00100000:2.0:1790772485.206601:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359360 00000100:00100000:2.0:1790772485.206656:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790772485.206665:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:11695:x1877760813359360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772485.207484:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:11695:x1877760813359360:12345-0@lo:502:llog_process_th.0 Request processed in 817us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772485.207495:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790772485.207573:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11695:1877760813359360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772485.207601:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772485.207609:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772485.207611:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790772485.207617:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9328bb7d8800 00000020:00000080:3.0:1790772485.207618:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772485.207702:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11695:1877760813359488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.207749:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.207789:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886db2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772485.207919:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359488 00000100:00100000:0.0:1790772485.207926:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359488 00000100:00100000:0.0:1790772485.207969:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790772485.207978:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:11695:x1877760813359488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772485.208176:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+17:11695:x1877760813359488:12345-0@lo:502:llog_process_th.0 Request processed in 198us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772485.208183:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790772485.208482:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11695:1877760813359488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772485.208514:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772485.208519:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772485.208520:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790772485.208524:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790772485.208746:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790772485.208766:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772485.208776:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772485.208788:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772485.208797:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772485.208800:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328ba5e9800 from 7 10000000:01000000:0.0:1790772485.208803:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772485.208827:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772485.208835:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772485.208854:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772485.208870:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.208928:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772485.208955:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9894000 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.209036:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359616 00000100:00100000:3.0:1790772485.209041:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359616 00000100:00100000:3.0:1790772485.209066:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790772485.209074:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:5852:x1877760813359616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772485.209083:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772485.209097:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be1734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be172d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.209118:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be1734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be172d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.209127:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be1734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be172d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.209135:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9c00, rc 0) 00000100:00100000:3.0:1790772485.209168:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813359616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.209175:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790772485.209209:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772485.209223:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.209239:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772485.209286:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.209310:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.209324:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886db2480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.209334:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359744 00000100:00100000:3.0:1790772485.209337:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359744 00000100:00100000:3.0:1790772485.209357:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790772485.209363:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813359744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.210316:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813359744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 950us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.210325:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790772485.212671:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.212744:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772485.212824:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772485.213204:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813359872 00000100:00100000:1.0:1790772485.213212:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813359872 00000100:00100000:1.0:1790772485.213256:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790772485.213264:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813359872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772485.213438:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813359872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772485.213446:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790772485.221127:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772485.221184:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813359872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772485.231732:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790772485.233888:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11698:1877760813360000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.233971:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.234008:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360000 00000100:00100000:3.0:1790772485.234014:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360000 00000100:00100000:3.0:1790772485.234072:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790772485.234081:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:11698:x1877760813360000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.234292:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+18:11698:x1877760813360000:12345-0@lo:502:llog_process_th.0 Request processed in 211us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.234300:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790772485.234354:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.234375:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11698:1877760813360000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772485.234408:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772485.234418:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772485.234420:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790772485.234427:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9328ba5e9800 00000020:00000080:3.0:1790772485.234429:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772485.234521:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11698:1877760813360128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.234552:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.234575:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360128 00000100:00100000:3.0:1790772485.234579:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360128 00000100:00100000:3.0:1790772485.234602:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790772485.234608:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:11698:x1877760813360128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.234703:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+18:11698:x1877760813360128:12345-0@lo:502:llog_process_th.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.234709:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790772485.234735:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.234745:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11698:1877760813360128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772485.234759:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772485.234762:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772485.234763:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790772485.234767:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790772485.234812:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790772485.234828:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772485.234837:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.234848:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772485.234867:0:5852:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790772485.234869:0:5852:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891b62000 from 7 10000000:01000000:3.0:1790772485.234872:0:5852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772485.234915:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.234923:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.234932:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772485.234943:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813360256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.234970:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.234982:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.234993:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360256 00000100:00100000:3.0:1790772485.234997:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360256 00000100:00100000:3.0:1790772485.235016:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1790772485.235022:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:5852:x1877760813360256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772485.235030:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772485.235041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be1742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be173b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.235060:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be1742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be173b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.235070:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be1742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be173b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.235103:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9a00, rc 0) 00000100:00100000:3.0:1790772485.235131:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813360256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.235137:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1790772485.235165:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813360256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772485.235177:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.235185:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772485.235223:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813360384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.235244:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.235256:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.235267:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360384 00000100:00100000:3.0:1790772485.235270:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360384 00000100:00100000:3.0:1790772485.235290:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790772485.235295:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813360384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.235516:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813360384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.235523:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790772485.235554:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813360384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.235579:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813360512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.235612:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.235634:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.235646:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360512 00000100:00100000:3.0:1790772485.235650:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360512 00000100:00100000:3.0:1790772485.235671:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790772485.235676:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813360512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.235780:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:5852:x1877760813360512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.235786:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790772485.235822:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12e36d38-efd9-4a85-b7c8-c9520302915a:5852:1877760813360512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772485.236070:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11700:1877760813360640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.236103:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.236122:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360640 00000100:00100000:3.0:1790772485.236125:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360640 00000100:00100000:3.0:1790772485.236145:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790772485.236152:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:11700:x1877760813360640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.236265:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b2103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:11700:x1877760813360640:12345-0@lo:502:llog_process_th.0 Request processed in 113us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.236272:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790772485.236303:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.236314:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11700:1877760813360640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772485.236333:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772485.236340:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772485.236343:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790772485.236349:0:11700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff932891b62000 00000020:00000080:3.0:1790772485.236352:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772485.236410:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11700:1877760813360768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.236444:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772485.236463:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360768 00000100:00100000:3.0:1790772485.236466:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360768 00000100:00100000:3.0:1790772485.236486:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1790772485.236492:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:11700:x1877760813360768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772485.236607:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:11700:x1877760813360768:12345-0@lo:502:llog_process_th.0 Request processed in 114us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772485.236613:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1790772485.236643:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772485.236653:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12e36d38-efd9-4a85-b7c8-c9520302915a:11700:1877760813360768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772485.236669:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772485.236673:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772485.236675:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790772485.236678:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790772485.236716:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790772485.236730:0:5852:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772485.236737:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.236747:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772485.899164:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772486.285286:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790772486.347298:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772486.347331:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813360896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772486.347427:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772486.347621:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813360896 00000100:00100000:1.0:1790772486.347634:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813360896 00000100:00100000:1.0:1790772486.347706:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790772486.347715:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813360896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772486.347753:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790772486.347755:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772486.348050:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813360896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 335us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772486.348058:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1790772486.351963:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328b8d6bb80 x1877760813360896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772486.351996:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813360896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790772486.923108:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772487.883604:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813361024:0@lo:400:kworker.0 00000100:00100000:0.0:1790772487.883691:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772487.883937:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813361152:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.883972:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772487.883977:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361024 00000100:00100000:3.0:1790772487.883985:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361024 00000100:00100000:2.0:1790772487.883997:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772487.884002:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813361280:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884024:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772487.884027:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790772487.884036:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813361024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884046:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361152 00000100:00100000:2.0:1790772487.884049:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361152 00000100:00100000:2.0:1790772487.884074:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361280 00000100:00100000:2.0:1790772487.884077:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361280 00000100:00100000:2.0:1790772487.884101:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790772487.884107:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813361152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884145:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813361152:12345-0@lo:400:kworker.0 Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772487.884152:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790772487.884178:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790772487.884184:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813361280:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790772487.884199:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772487.884211:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813361280:12345-0@lo:400:kworker.0 Request processed in 28us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772487.884217:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790772487.884249:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813361408:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884278:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772487.884314:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772487.884320:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813361536:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884350:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772487.884373:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361536 00000100:00100000:2.0:1790772487.884376:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361536 00000100:00100000:2.0:1790772487.884400:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790772487.884406:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813361536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884440:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813361536:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772487.884446:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790772487.884469:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361408 00000100:00100000:1.0:1790772487.884474:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361408 00000100:00100000:2.0:1790772487.884479:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813361664:0@lo:400:kworker.0 00000100:00100000:1.0:1790772487.884501:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790772487.884508:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813361408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772487.884547:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813361408:12345-0@lo:400:kworker.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772487.884552:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1790772487.884575:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772487.884673:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813361024:12345-0@lo:400:kworker.0 Request processed in 638us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772487.884687:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790772487.884745:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813361536:0@lo:400:kworker.0 00010000:00080000:3.0:1790772487.884758:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b49880 x1877760813361408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772487.884767:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813361408:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884809:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772487.884821:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813361024:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884849:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813361280:0@lo:400:kworker.0 00000100:00100000:2.0:1790772487.884859:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813361152:0@lo:400:kworker.0 00000100:00100000:3.0:1790772487.884989:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361664 00000100:00100000:3.0:1790772487.884993:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361664 00000100:00100000:3.0:1790772487.885027:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790772487.885034:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813361664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772487.885079:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813361664:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772487.885085:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1790772487.885131:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772487.885306:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813361664:0@lo:400:kworker.0 00010000:00010000:0.0:1790772487.950035:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772488.305182:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772488.305243:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772488.305274:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772488.305313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772488.305418:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548480 00000100:00100000:3.0:1790772488.305421:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548224 00000100:00100000:3.0:1790772488.305427:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548224 00000100:00100000:1.0:1790772488.305427:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548480 00000100:00100000:3.0:1790772488.305486:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:3.0:1790772488.305496:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796548224:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772488.305507:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1790772488.305514:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796548480:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772488.305572:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796548480:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772488.305580:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00080000:1.0:1790772488.305602:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772488.314859:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796548224:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 9350us (9674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772488.314889:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:2.0:1790772488.315237:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548352 00000100:00100000:2.0:1790772488.315247:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548352 00000100:00100000:2.0:1790772488.315303:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548608 00000100:00100000:2.0:1790772488.315306:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548608 00000100:00100000:3.0:1790772488.315608:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:3.0:1790772488.315621:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796548352:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772488.315682:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796548352:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 65us (10406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772488.315689:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00080000:3.0:1790772488.315750:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772488.316179:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:2.0:1790772488.316189:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796548608:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772488.316225:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796548608:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (10911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772488.316243:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:2.0:1790772488.396568:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772488.396606:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772488.396677:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772488.396770:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361792 00000100:00100000:0.0:1790772488.396778:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361792 00000100:00100000:0.0:1790772488.396830:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790772488.396840:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813361792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772488.396901:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772488.396948:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813361792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772488.396955:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790772488.399957:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813361792:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1790772488.438248:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1790772488.475833:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1790772488.971138:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772489.995087:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772491.019456:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772491.467339:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813361920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772491.467465:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772491.467709:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813361920 00000100:00100000:1.0:1790772491.467718:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813361920 00000100:00100000:1.0:1790772491.467787:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790772491.467797:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813361920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772491.467846:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772491.467921:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813361920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772491.467929:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1790772491.468091:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790772491.468124:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b4a300 x1877760813361920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772491.468143:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813361920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790772492.043566:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772493.003417:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772493.003440:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813362048:0@lo:400:kworker.0 00000100:00100000:1.0:1790772493.003466:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813362304:0@lo:400:kworker.0 00000100:00100000:2.0:1790772493.003548:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813362560:0@lo:400:kworker.0 00000100:00100000:0.0:1790772493.003586:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813362176:0@lo:400:kworker.0 00000100:00100000:3.0:1790772493.007301:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772493.007308:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772493.011956:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362048 00000100:00100000:3.0:1790772493.011972:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362048 00000100:00100000:3.0:1790772493.012032:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1790772493.012042:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813362048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772493.012051:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813362432:0@lo:400:kworker.0 00000100:00100000:2.0:1790772493.012098:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772493.012251:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362432 00000100:00100000:0.0:1790772493.012256:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362432 00000100:00100000:0.0:1790772493.012376:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790772493.012385:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813362432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772493.012526:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813362432:12345-0@lo:400:kworker.0 Request processed in 142us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772493.012534:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790772493.012694:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790772493.012892:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b4bb80 x1877760813362432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772493.012907:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813362432:0@lo:400:kworker.0 00000100:00100000:2.0:1790772493.013078:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362304 00000100:00100000:2.0:1790772493.013084:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362304 00000100:00100000:2.0:1790772493.013127:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790772493.013136:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813362304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772493.017413:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813362048:12345-0@lo:400:kworker.0 Request processed in 5362us (10109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772493.017429:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:3.0:1790772493.017537:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772493.018404:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772493.018455:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362560 00000100:00100000:1.0:1790772493.018464:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362560 00000100:00100000:1.0:1790772493.018512:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790772493.018522:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813362560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772493.018970:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813362560:12345-0@lo:400:kworker.0 Request processed in 449us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772493.018987:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1790772493.019023:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772493.019060:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813362560:0@lo:400:kworker.0 00000100:00100000:3.0:1790772493.019260:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772493.019302:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813362688:0@lo:400:kworker.0 00000100:00100000:1.0:1790772493.019310:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362176 00000100:00100000:1.0:1790772493.019315:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362176 00000100:00100000:1.0:1790772493.019339:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790772493.019346:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813362176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772493.019415:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772493.019453:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362688 00000100:00100000:3.0:1790772493.019457:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362688 00000100:00100000:3.0:1790772493.019491:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772493.020462:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813362688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772493.020534:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813362688:12345-0@lo:400:kworker.0 Request processed in 1028us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772493.020541:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772493.020588:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790772493.020593:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328b8d69500, transno 4294967300 00000100:00100000:3.0:1790772493.020606:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813362688:0@lo:400:kworker.0 00000100:00100000:0.0:1790772493.021222:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813362048:0@lo:400:kworker.0 00000100:00080000:0.0:1790772493.021301:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772493.021486:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813362304:12345-0@lo:400:kworker.0 Request processed in 8350us (14174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772493.021495:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790772493.021766:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813362304:0@lo:400:kworker.0 00000100:00100000:1.0:1790772493.022251:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813362176:12345-0@lo:400:kworker.0 Request processed in 2902us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772493.022259:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790772493.022390:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813362176:0@lo:400:kworker.0 00010000:00010000:1.0:1790772493.069741:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772493.427397:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772493.427531:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548736 00000100:00100000:3.0:1790772493.427542:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548736 00000100:00100000:3.0:1790772493.427630:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 281 00000100:00100000:3.0:1790772493.427640:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796548736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772493.427718:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796548736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772493.427726:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 281 00000100:00100000:1.0:1790772493.431816:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772493.431859:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772493.431924:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772493.432026:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548864 00000100:00100000:3.0:1790772493.432037:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548864 00000100:00100000:3.0:1790772493.432110:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549120 00000100:00100000:3.0:1790772493.432113:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549120 00000100:00100000:3.0:1790772493.432133:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1790772493.432142:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796548864:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772493.432220:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796548864:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772493.432227:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1790772493.432245:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:3.0:1790772493.432266:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796549120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772493.432304:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796549120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772493.432310:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00080000:1.0:1790772493.432622:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772493.432701:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796548992 00000100:00100000:2.0:1790772493.432707:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796548992 00000100:00100000:2.0:1790772493.432757:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1790772493.432764:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796548992:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772493.432794:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796548992:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 31us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772493.432947:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00080000:1.0:1790772493.433071:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772493.517143:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813362816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772493.517371:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772493.517441:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362816 00000100:00100000:2.0:1790772493.517450:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362816 00000100:00100000:2.0:1790772493.517510:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790772493.517519:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813362816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772493.517569:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772493.517808:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813362816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772493.517817:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790772493.518574:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813362816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772494.091035:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772495.117082:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772496.141968:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772496.524312:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790772496.587378:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772496.587405:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813362944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772496.587488:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772496.587550:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813362944 00000100:00100000:3.0:1790772496.587560:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813362944 00000100:00100000:3.0:1790772496.587633:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772496.587644:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813362944:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772496.587678:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790772496.587910:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772496.587982:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813362944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 340us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772496.587991:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790772496.588085:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b49f80 x1877760813362944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772496.588121:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813362944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772497.163115:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772498.123261:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813363072:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.123360:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772498.123421:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813363584:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.123447:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772498.123470:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772498.123476:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813363456:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.123498:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772498.123573:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363072 00000100:00100000:1.0:1790772498.123582:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363072 00000100:00100000:1.0:1790772498.123633:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1790772498.123651:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813363072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772498.123707:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813363072:12345-0@lo:400:kworker.0 Request processed in 64us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772498.123732:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790772498.124024:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813363072:0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124189:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813363200:0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124220:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772498.124252:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813363712:0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124284:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772498.124311:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772498.124327:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813363328:0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124348:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772498.124374:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363584 00000100:00100000:3.0:1790772498.124378:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363584 00000100:00100000:3.0:1790772498.124409:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363200 00000100:00100000:3.0:1790772498.124412:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363200 00000100:00100000:3.0:1790772498.124421:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363328 00000100:00100000:3.0:1790772498.124423:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363328 00000100:00100000:3.0:1790772498.124434:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790772498.124449:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813363584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124489:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813363584:12345-0@lo:400:kworker.0 Request processed in 40us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772498.124495:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790772498.124508:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790772498.124514:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813363200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124546:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813363200:12345-0@lo:400:kworker.0 Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772498.124551:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790772498.124561:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790772498.124567:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813363328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124591:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813363328:12345-0@lo:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772498.124597:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790772498.124613:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363456 00000100:00100000:3.0:1790772498.124617:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363456 00000100:00100000:3.0:1790772498.124638:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363712 00000100:00100000:3.0:1790772498.124652:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363712 00000100:00100000:3.0:1790772498.124667:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790772498.124674:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813363456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772498.124706:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813363456:12345-0@lo:400:kworker.0 Request processed in 33us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772498.124712:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772498.124933:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790772498.124943:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813363712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.124976:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813363712:12345-0@lo:400:kworker.0 Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772498.124982:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1790772498.125018:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfc04700 x1877760813363456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772498.125037:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813363456:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.125051:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813363584:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.125093:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813363328:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.125102:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813363200:0@lo:400:kworker.0 00000100:00100000:2.0:1790772498.125110:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813363712:0@lo:400:kworker.0 00000100:00080000:1.0:1790772498.125769:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772498.125775:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772498.125777:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772498.187109:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772498.545224:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772498.545297:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772498.545416:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549248 00000100:00100000:3.0:1790772498.545426:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549248 00000100:00100000:3.0:1790772498.545478:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 283 00000100:00100000:3.0:1790772498.545501:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796549248:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772498.545593:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796549248:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 93us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772498.545600:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 283 00000100:00100000:0.0:1790772498.546517:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549376 00000100:00100000:0.0:1790772498.546528:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549376 00000100:00100000:0.0:1790772498.546594:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1790772498.546601:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796549376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:2.0:1790772498.546784:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772498.546869:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796549376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 267us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772498.546906:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:1.0:1790772498.561608:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772498.562178:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549632 00000100:00100000:0.0:1790772498.562189:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549632 00000100:00100000:0.0:1790772498.562283:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1790772498.562293:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796549632:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:2.0:1790772498.562393:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772498.563163:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796549632:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 868us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772498.563175:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:2.0:1790772498.565910:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772498.566005:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549504 00000100:00100000:3.0:1790772498.566015:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549504 00000100:00100000:3.0:1790772498.566107:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1790772498.566116:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2353:x1877760796549504:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1790772498.566146:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be167e 00000100:00080000:3.0:1790772498.566154:0:6704:0:(import.c:65:import_set_state_nolock()) ffff93288f0e7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772498.566224:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1790772498.566940:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+2:2353:x1877760796549504:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 822us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772498.566949:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00080000:2.0:1790772498.567068:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790772498.567853:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772498.645211:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772498.645245:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813363840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772498.645354:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772498.645438:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363840 00000100:00100000:2.0:1790772498.645447:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363840 00000100:00100000:2.0:1790772498.645495:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772498.645505:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813363840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772498.645549:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772498.645600:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813363840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772498.645607:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772498.645680:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813363840:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790772498.691683:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:3.0:1790772498.691693:0:7658:0:(genops.c:885:class_export_put()) final put ffff93288f0e3000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:1.0:1790772498.691761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f0e3000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 for lustre-OST0001 00000020:00000080:1.0:1790772498.691827:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f0e7800 for lustre-OST0001 00010000:00010000:0.0:1790772499.211121:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772500.235461:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772501.259100:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772501.708312:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772501.708338:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813363968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772501.708432:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772501.708596:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813363968 00000100:00100000:3.0:1790772501.708605:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813363968 00000100:00100000:3.0:1790772501.708673:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790772501.708685:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813363968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772501.708724:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772501.708777:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813363968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772501.708785:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1790772501.709298:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790772501.709337:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfc05f80 x1877760813363968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772501.709359:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813363968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772502.283269:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772503.243408:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772503.243450:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813364480:0@lo:400:kworker.0 00000100:00100000:2.0:1790772503.243470:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813364352:0@lo:400:kworker.0 00000100:00100000:1.0:1790772503.243548:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813364224:0@lo:400:kworker.0 00000100:00100000:0.0:1790772503.243553:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813364608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772503.245397:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772503.245486:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364352 00000100:00100000:2.0:1790772503.245495:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364352 00000100:00100000:2.0:1790772503.245549:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790772503.245560:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813364352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772503.245620:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813364352:12345-0@lo:400:kworker.0 Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772503.245627:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1790772503.245650:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772503.245816:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813364352:0@lo:400:kworker.0 00000100:00100000:3.0:1790772503.246334:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772503.246373:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813364096:0@lo:400:kworker.0 00000100:00100000:1.0:1790772503.246400:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772503.246418:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772503.246436:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf56b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813364736:0@lo:400:kworker.0 00000100:00100000:2.0:1790772503.246506:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364480 00000100:00100000:2.0:1790772503.246511:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364480 00000100:00100000:2.0:1790772503.246551:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772503.246559:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813364480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772503.246623:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772503.246653:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364096 00000100:00100000:3.0:1790772503.246657:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364096 00000100:00100000:3.0:1790772503.246683:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790772503.246689:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772503.246727:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813364096:12345-0@lo:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772503.246733:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1790772503.247460:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772503.247516:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364224 00000100:00100000:0.0:1790772503.247521:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364224 00000100:00100000:0.0:1790772503.247545:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364608 00000100:00100000:0.0:1790772503.247547:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364608 00000100:00100000:0.0:1790772503.247563:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790772503.247569:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813364224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772503.247613:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813364224:12345-0@lo:400:kworker.0 Request processed in 43us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772503.247620:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790772503.247637:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790772503.247645:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813364224:0@lo:400:kworker.0 00000100:00100000:0.0:1790772503.247646:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813364608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772503.247684:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813364608:12345-0@lo:400:kworker.0 Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772503.247690:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790772503.247716:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813364608:0@lo:400:kworker.0 00000100:00080000:1.0:1790772503.248326:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772503.248332:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772503.248362:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813364096:0@lo:400:kworker.0 00000100:00100000:2.0:1790772503.251360:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813364480:12345-0@lo:400:kworker.0 Request processed in 4793us (5018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772503.251376:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772503.251407:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364736 00000100:00100000:2.0:1790772503.251415:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364736 00010000:00080000:1.0:1790772503.252869:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328c0b49f80 x1877760813364480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772503.252917:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813364480:0@lo:400:kworker.0 00000100:00080000:1.0:1790772503.254367:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772503.254660:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772503.254678:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813364736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772503.254802:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813364736:12345-0@lo:400:kworker.0 Request processed in 131us (8179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772503.254810:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790772503.258782:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf56b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813364736:0@lo:400:kworker.0 00010000:00010000:3.0:1790772503.307305:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772503.671116:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772503.671196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772503.671312:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772503.671477:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549888 00000100:00100000:3.0:1790772503.671493:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549888 00000100:00100000:0.0:1790772503.671577:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550016 00000100:00100000:0.0:1790772503.671587:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550016 00000100:00100000:3.0:1790772503.671612:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1790772503.671629:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796549888:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772503.671651:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:0.0:1790772503.671664:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796550016:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772503.671769:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796550016:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 108us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772503.671776:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00080000:2.0:1790772503.671997:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772503.672122:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796549888:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 494us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772503.672134:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:1.0:1790772503.672512:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796549760 00000100:00100000:1.0:1790772503.672536:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796549760 00000100:00100000:1.0:1790772503.672627:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 285 00000100:00100000:1.0:1790772503.672636:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796549760:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772503.672694:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796549760:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 60us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772503.672702:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 285 00000100:00100000:3.0:1790772503.763120:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813364864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772503.763232:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772503.763347:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364864 00000100:00100000:3.0:1790772503.763358:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364864 00000100:00100000:3.0:1790772503.763414:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790772503.763424:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813364864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772503.763476:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772503.763533:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813364864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772503.763555:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790772503.763617:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813364864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772504.332487:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772505.355345:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772506.379187:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772506.781314:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790772506.828184:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772506.828476:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813364992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772506.828539:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772506.828636:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813364992 00000100:00100000:2.0:1790772506.828643:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813364992 00000100:00100000:2.0:1790772506.828698:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790772506.828707:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813364992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772506.828742:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772506.828783:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813364992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772506.828790:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1790772506.828828:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfc04000 x1877760813364992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772506.828845:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813364992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772506.828918:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790772507.403515:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772508.367030:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813365504:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367115:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.367172:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790772508.367178:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813365120:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367208:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.367232:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813365632:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367256:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.367283:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813365248:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367319:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.367338:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813365760:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367356:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.367374:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772508.367379:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813365376:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367398:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.367431:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365504 00000100:00100000:3.0:1790772508.367439:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365504 00000100:00100000:3.0:1790772508.367491:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365760 00000100:00100000:3.0:1790772508.367495:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365760 00000100:00100000:3.0:1790772508.367513:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772508.367521:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813365504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367579:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813365504:12345-0@lo:400:kworker.0 Request processed in 57us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.367585:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772508.367600:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790772508.367607:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813365760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367637:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813365760:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.367643:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790772508.367659:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365120 00000100:00100000:3.0:1790772508.367663:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365120 00000100:00100000:3.0:1790772508.367685:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790772508.367691:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813365120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367719:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813365120:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.367724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790772508.367749:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365632 00000100:00100000:3.0:1790772508.367752:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365632 00000100:00100000:3.0:1790772508.367776:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365248 00000100:00100000:3.0:1790772508.367779:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365248 00000100:00100000:3.0:1790772508.367788:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365376 00000100:00100000:3.0:1790772508.367791:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365376 00000100:00100000:3.0:1790772508.367804:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790772508.367810:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813365632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367841:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813365632:12345-0@lo:400:kworker.0 Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.367856:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790772508.367869:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790772508.367898:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813365248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367929:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813365248:12345-0@lo:400:kworker.0 Request processed in 56us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.367933:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790772508.367944:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790772508.367950:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813365376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.367974:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813365376:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.367979:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1790772508.368004:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772508.368008:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772508.368010:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772508.368042:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813365376:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.368052:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813365248:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.368061:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813365760:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.368087:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813365120:0@lo:400:kworker.0 00000100:00100000:3.0:1790772508.368108:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813365632:0@lo:400:kworker.0 00010000:00080000:3.0:1790772508.368122:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bf62b800 x1877760813365504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772508.368131:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813365504:0@lo:400:kworker.0 00010000:00010000:1.0:1790772508.429604:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772508.555661:0:11864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:48:27 (1790772507) 00000100:00100000:0.0:1790772508.799717:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772508.799751:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772508.799776:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772508.799806:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550400 00000100:00100000:0.0:1790772508.799826:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550400 00000100:00100000:0.0:1790772508.799899:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550272 00000100:00100000:0.0:1790772508.799903:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550272 00000100:00100000:0.0:1790772508.799926:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1790772508.799936:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796550400:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772508.800012:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796550400:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772508.800019:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1790772508.800037:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:0.0:1790772508.800042:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796550272:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772508.800065:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796550272:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772508.800071:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00080000:0.0:1790772508.800100:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772508.803744:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550144 00000100:00100000:3.0:1790772508.803764:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550144 00000100:00100000:3.0:1790772508.803815:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:3.0:1790772508.803824:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796550144:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772508.803918:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796550144:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 94us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.803925:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:0.0:1790772508.875934:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813365888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772508.876015:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772508.876169:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813365888 00000100:00100000:3.0:1790772508.876178:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813365888 00000100:00100000:3.0:1790772508.876232:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790772508.876242:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813365888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772508.876290:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772508.876340:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813365888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772508.876347:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790772508.876392:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813365888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772509.453102:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772510.474976:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772510.698519:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772510.698793:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550528 00000100:00100000:3.0:1790772510.698804:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550528 00000100:00100000:3.0:1790772510.698997:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:3.0:1790772510.699010:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:10210:x1877760796550528:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772510.699035:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772510.699087:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5085c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772510.699160:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1750 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772510.699195:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772510.699210:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772510.699248:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772510.699252:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772510.699299:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772510.699966:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5085c expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772510.700067:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5085c expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772510.700078:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65700) 00010000:00010000:3.0:1790772510.700081:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772510.700085:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8c00, rc 0) 00000100:00100000:3.0:1790772510.700164:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:10210:x1877760796550528:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1158us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772510.700171:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00080000:0.0:1790772510.700825:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772510.716965:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772510.718872:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550656 00000100:00100000:0.0:1790772510.718899:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550656 00000100:00100000:0.0:1790772510.718976:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1790772510.718994:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:10211:x1877760796550656:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772510.719015:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772510.719036:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50863 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719186:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719201:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719213:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719228:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719235:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719242:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719633:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92000/0xd3c7635991be176c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719644:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92000/0xd3c7635991be176c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719652:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92000/0xd3c7635991be176c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772510.719682:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772510.719686:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772510.719709:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92000/0xd3c7635991be176c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719731:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719738:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719745:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719752:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772510.719757:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719764:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719777:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65700) 00010000:00010000:0.0:1790772510.719779:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772510.719785:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719791:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be175e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719803:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719810:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719816:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719828:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772510.719831:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719837:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719846:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9328946b8300) 00010000:00010000:0.0:1790772510.719848:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772510.719851:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719857:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719942:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50863 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719957:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92000/0xd3c7635991be176c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50863 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772510.719965:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9328946b8100) 00010000:00010000:0.0:1790772510.719968:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772510.719970:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92000, rc 0) 00000100:00100000:0.0:1790772510.720037:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:10211:x1877760796550656:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1044us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772510.720045:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1790772510.723691:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772510.723933:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796550912 00000100:00100000:1.0:1790772510.723944:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796550912 00000100:00100000:1.0:1790772510.724015:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1790772510.724026:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:10211:x1877760796550912:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772510.724050:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772510.724081:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1773 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5086a expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724167:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724181:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724193:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724240:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724259:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724266:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724765:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da200/0xd3c7635991be1788 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724776:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da200/0xd3c7635991be1788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724783:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da200/0xd3c7635991be1788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772510.724794:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790772510.724977:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724986:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724992:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.724998:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772510.725003:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725011:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725032:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9328946b8100) 00010000:00010000:1.0:1790772510.725035:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772510.725041:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725047:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be177a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725071:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725076:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725081:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725086:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772510.725089:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725095:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725102:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9328a16c3000) 00010000:00010000:1.0:1790772510.725104:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772510.725107:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.725113:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1781 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.729454:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1773 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5086a expref: 10 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.729485:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da200/0xd3c7635991be1788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5086a expref: 9 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772510.729495:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:1.0:1790772510.729498:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772510.729502:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da200, rc 0) 00000100:00100000:1.0:1790772510.730168:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10211:x1877760796550912:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 6140us (6485us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790772510.730178:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:0.0:1790772510.745073:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772510.745804:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796551040 00000100:00100000:3.0:1790772510.745816:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796551040 00000100:00100000:0.0:1790772510.745991:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:0.0:1790772510.746002:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10211:x1877760796551040:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790772510.746724:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10211:x1877760796551040:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 719us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772510.746733:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000040:00080000:0.0:1790772510.859689:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790772511.508069:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772511.951071:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813366016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772511.951158:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772511.951237:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366016 00000100:00100000:1.0:1790772511.951244:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366016 00000100:00100000:1.0:1790772511.951423:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772511.951433:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813366016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772511.951476:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772511.951519:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813366016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772511.951526:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1790772511.951569:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bfc06d80 x1877760813366016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772511.951588:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813366016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772511.952228:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772512.523606:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772513.297817:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.297940:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796551168 00000100:00100000:0.0:1790772513.297951:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796551168 00000100:00100000:0.0:1790772513.298028:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1790772513.298038:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10253:x1877760796551168:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772513.298059:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1790772513.298081:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790772513.298089:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50871 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298161:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298176:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298190:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298206:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298213:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298248:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298443:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298450:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298457:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298462:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772513.298466:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298474:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298486:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65700) 00010000:00010000:0.0:1790772513.298489:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.298493:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298500:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be179d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298512:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298518:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298530:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298536:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772513.298540:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298548:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298558:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9328946b8300) 00010000:00010000:0.0:1790772513.298561:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.298564:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298571:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298617:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1796 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50871 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298627:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65700) 00010000:00010000:0.0:1790772513.298629:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.298632:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50871 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.298642:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93600, rc 0) 00000100:00100000:0.0:1790772513.298711:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10253:x1877760796551168:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 673us (902us total) trans 0 rc 301/301 00000100:00100000:0.0:1790772513.298726:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:2.0:1790772513.319607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772513.319751:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796551424 00000100:00100000:3.0:1790772513.319974:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796551424 00000100:00100000:3.0:1790772513.320144:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1790772513.320159:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10253:x1877760796551424:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1790772513.320245:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772513.320283:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1750 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5085c expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.320311:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65700) 00010000:00010000:3.0:1790772513.320325:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772513.321029:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.321050:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.321063:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.321078:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.321086:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.321092:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772513.330723:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790772513.330750:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.330764:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.330794:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.330803:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772513.330810:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.330820:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.330842:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff932884f65100) 00010000:00010000:3.0:1790772513.330847:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772513.330852:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.330859:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be17ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772513.330922:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000014757cfb reply state 0000000037dc9413 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772513.330935:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772513.331113:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:10253:x1877760796551424:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 10952us (11516us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790772513.331123:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00010000:00010000:2.0:1790772513.340634:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772513.340658:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772513.340685:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772513.340692:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772513.340698:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772513.340708:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772513.340732:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff932884f65400) 00010000:00010000:2.0:1790772513.340736:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772513.340743:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772513.340749:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be17b2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772513.482979:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.483098:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796551552 00000100:00100000:0.0:1790772513.483111:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796551552 00000100:00100000:0.0:1790772513.483178:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1790772513.483188:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10261:x1877760796551552:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:0.0:1790772513.483212:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772513.483237:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be17b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50878 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.483306:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.483321:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.483332:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772513.483368:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772513.483372:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772513.483414:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.483437:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be17b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50878 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.483454:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50878 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.483480:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772513.483482:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772513.483486:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93200, rc 0) 00000100:00100000:0.0:1790772513.483551:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:10261:x1877760796551552:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 364us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.483558:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1790772513.484516:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813366144:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484576:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772513.484629:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813366656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484654:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772513.484678:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772513.484684:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813366528:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484708:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772513.484737:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813366272:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484759:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772513.484776:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813366784:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484795:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772513.484813:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772513.484817:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813366400:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484838:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772513.484868:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366144 00000100:00100000:0.0:1790772513.484893:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366144 00000100:00100000:0.0:1790772513.484928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790772513.484936:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813366144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.484989:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3318:x1877760813366144:12345-0@lo:400:kworker.0 Request processed in 53us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.484996:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790772513.485040:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366656 00000100:00100000:0.0:1790772513.485044:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366656 00000100:00100000:0.0:1790772513.485089:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366272 00000100:00100000:0.0:1790772513.485092:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366272 00000100:00100000:0.0:1790772513.485103:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366400 00000100:00100000:0.0:1790772513.485105:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366400 00000100:00100000:0.0:1790772513.485118:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790772513.485125:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813366656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485156:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813366656:12345-0@lo:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.485162:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790772513.485174:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790772513.485180:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813366272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485212:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813366272:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.485218:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790772513.485228:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790772513.485234:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813366400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485260:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813366400:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.485266:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790772513.485284:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366528 00000100:00100000:0.0:1790772513.485288:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366528 00000100:00100000:0.0:1790772513.485312:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813366784 00000100:00100000:0.0:1790772513.485321:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813366784 00000100:00100000:0.0:1790772513.485339:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772513.485345:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813366528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485386:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813366528:12345-0@lo:400:kworker.0 Request processed in 41us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.485392:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772513.485403:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772513.485408:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813366784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485434:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813366784:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.485440:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1790772513.485464:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772513.485469:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772513.485472:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772513.485504:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813366400:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485514:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813366272:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485521:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813366784:0@lo:400:kworker.0 00010000:00080000:0.0:1790772513.485555:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cd180 x1877760813366528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772513.485565:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813366528:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485572:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12e36d38-efd9-4a85-b7c8-c9520302915a:3318:1877760813366144:0@lo:400:kworker.0 00000100:00100000:0.0:1790772513.485581:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813366656:0@lo:400:kworker.0 00010000:00010000:2.0:1790772513.547392:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772513.661389:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.661928:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796551680 00000100:00100000:0.0:1790772513.661939:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796551680 00000100:00100000:0.0:1790772513.662023:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1790772513.662033:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:10267:x1877760796551680:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772513.662054:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772513.662075:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be17c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5087f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662136:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662167:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662180:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662196:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662203:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662210:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662316:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92e00/0xd3c7635991be17dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662325:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92e00/0xd3c7635991be17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662331:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92e00/0xd3c7635991be17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772513.662368:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790772513.662372:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772513.662409:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92e00/0xd3c7635991be17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662421:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662428:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662435:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662441:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772513.662445:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662454:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662466:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772513.662469:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.662475:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662482:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662506:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662524:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662530:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662536:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772513.662539:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662546:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662554:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9328946b8900) 00010000:00010000:0.0:1790772513.662557:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.662560:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662567:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662597:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be17c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5087f expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662610:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92e00/0xd3c7635991be17dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5087f expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.662617:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772513.662620:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772513.662627:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92e00, rc 0) 00000100:00100000:0.0:1790772513.662948:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:10267:x1877760796551680:12345-192.168.201.34@tcp:101:bash.0 Request processed in 913us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.662955:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1790772513.673595:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.673716:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796551936 00000100:00100000:0.0:1790772513.673726:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796551936 00000100:00100000:0.0:1790772513.673801:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1790772513.673812:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:10267:x1877760796551936:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772513.673834:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772513.673855:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be17e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50886 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.674280:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.674297:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.674308:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.674383:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.674392:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.674398:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772513.674994:0:8380:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1790772513.675181:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675192:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675199:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675233:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675240:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675247:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675252:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772513.675257:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675264:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675277:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772513.675280:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.675285:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675291:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be17ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772513.675314:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000549cdd62 reply state 00000000a946cb13 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772513.675324:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772513.675356:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be17e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 14 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675371:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 13 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.675383:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772513.675386:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772513.675388:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:0.0:1790772513.675470:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10267:x1877760796551936:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1659us (1882us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790772513.675478:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:2.0:1790772513.680632:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:0.0:1790772513.680714:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.680727:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.680735:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.680741:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772513.680746:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.680772:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.680787:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8900) 00010000:00010000:0.0:1790772513.680790:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772513.680794:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.680801:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be17f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772513.680909:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796552064 00000100:00100000:1.0:1790772513.680919:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796552064 00000100:00100000:1.0:1790772513.680952:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1790772513.680965:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1877760796552064:12345-192.168.201.34@tcp:8:bash.0 00010000:00080000:1.0:1790772513.680992:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:1.0:1790772513.681026:0:6706:0:(genops.c:1384:class_connect()) connect: client 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677, cookie 0xd3c7635991be1806 00002000:00100000:1.0:1790772513.681037:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677/ffff9328bf6ca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790772513.681064:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790772513.681291:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790772513.681319:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9328bf6ce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772513.681375:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2353:x1877760796552064:12345-192.168.201.34@tcp:8:bash.0 Request processed in 415us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772513.681383:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1790772513.692519:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.692605:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796552192 00000100:00100000:0.0:1790772513.692615:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796552192 00000100:00100000:0.0:1790772513.692691:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1790772513.692701:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:0:x1877760796552192:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772513.692720:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772513.692743:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5088d expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772513.692769:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772513.692800:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1790772513.692804:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772513.692814:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.692834:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.692866:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92200, rc 0) 00000100:00100000:0.0:1790772513.692953:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:0:x1877760796552192:12345-192.168.201.34@tcp:101:bash.0 Request processed in 254us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.692960:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00080000:1.0:1790772513.693383:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772513.704709:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.704821:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796552320 00000100:00100000:0.0:1790772513.704831:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796552320 00000100:00100000:0.0:1790772513.704976:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772513.704987:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:10267:x1877760796552320:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772513.705017:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772513.705037:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50894 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.705085:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.705095:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772513.705099:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772513.705279:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.705317:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.705333:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772513.705362:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813366912:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772513.705445:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0b6c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772513.723607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.723724:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813366912:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772513.723758:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.723778:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93600, rc 0) 00000100:00100000:0.0:1790772513.723841:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:10267:x1877760796552320:12345-192.168.201.34@tcp:101:bash.0 Request processed in 18855us (19141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.723850:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1790772513.724505:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796552448 00000100:00100000:1.0:1790772513.724515:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796552448 00010000:00010000:1.0:1790772513.724552:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772513.724591:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1790772513.724600:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796552448:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772513.724613:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772513.724648:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772513.724661:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772513.724684:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009588fb75/0xd3c7635991be180d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5088d expref: 8 pid: 6705 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772513.724699:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772513.724703:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772513.724711:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772513.724722:0:8465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772513.724754:0:8465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772513.724767:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8465:1877760813367040:192.168.201.34@tcp:105: 00000100:00100000:1.0:1790772513.725514:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff932889184840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772513.736936:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8465:1877760813367040:192.168.201.34@tcp:105: 00010000:00010000:1.0:1790772513.736966:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772513.737042:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796552448:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 12442us (13445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772513.737078:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1790772513.738591:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772513.739502:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796552704 00000100:00100000:2.0:1790772513.739515:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796552704 00000100:00100000:2.0:1790772513.739578:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1790772513.739588:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10267:x1877760796552704:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1790772513.743084:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10267:x1877760796552704:12345-192.168.201.34@tcp:35:bash.0 Request processed in 3483us (4487us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790772513.743123:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1790772513.851126:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772513.851231:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796552960 00000100:00100000:3.0:1790772513.851242:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796552960 00000100:00100000:3.0:1790772513.851305:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:3.0:1790772513.851316:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10277:x1877760796552960:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772513.851357:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772513.851380:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be181b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5089b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772513.851472:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790772513.851599:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be181b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5089b expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.851614:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:3.0:1790772513.851617:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772513.851622:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be181b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5089b expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.851639:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8c00, rc 0) 00000100:00100000:3.0:1790772513.851703:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10277:x1877760796552960:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 388us (585us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1790772513.851710:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1790772513.855390:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.855487:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796553216 00000100:00100000:0.0:1790772513.855498:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796553216 00000100:00100000:0.0:1790772513.855554:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1790772513.855566:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10277:x1877760796553216:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772513.855800:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:10277:x1877760796553216:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 235us (430us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1790772513.855806:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1790772513.905973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772513.906038:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772513.906184:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796553344 00000100:00100000:3.0:1790772513.906195:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796553344 00000100:00100000:3.0:1790772513.906268:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:3.0:1790772513.906287:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796553344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772513.906376:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796553344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772513.906384:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:0.0:1790772513.908977:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796553472 00000100:00100000:0.0:1790772513.908992:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796553472 00000100:00100000:0.0:1790772513.909104:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1790772513.909115:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796553472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772513.909193:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796553472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (3230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.909233:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00080000:2.0:1790772513.909609:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772513.971457:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772513.971613:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796553600 00000100:00100000:3.0:1790772513.971624:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796553600 00000100:00100000:3.0:1790772513.971687:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1790772513.971710:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:10284:x1877760796553600:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772513.971736:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772513.971756:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508a2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.971822:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.971837:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.971847:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772513.971921:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790772513.971925:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772513.971944:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.971969:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508a2 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.971993:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508a2 expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772513.972014:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:3.0:1790772513.972017:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772513.972021:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8600, rc 0) 00000100:00100000:3.0:1790772513.972089:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:10284:x1877760796553600:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 379us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772513.972106:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1790772513.978612:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.978774:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796553856 00000100:00100000:0.0:1790772513.978785:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796553856 00000100:00100000:0.0:1790772513.978843:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1790772513.978853:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:10284:x1877760796553856:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772513.978911:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772513.978932:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1837 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508a9 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.979045:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be183e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.979060:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be183e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.979071:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be183e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772513.979084:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790772513.979209:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1837 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508a9 expref: 20 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.979227:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be183e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508a9 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.979236:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772513.979239:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772513.979242:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93800, rc 0) 00000100:00100000:0.0:1790772513.979331:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:10284:x1877760796553856:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 480us (730us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790772513.979338:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1790772513.985522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772513.985627:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796553984 00000100:00100000:0.0:1790772513.985637:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796553984 00000100:00100000:0.0:1790772513.985703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1790772513.985714:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:2357:x1877760796553984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772513.985730:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772513.985756:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be183e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508a9 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772513.985776:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772513.985781:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772513.985843:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:2357:x1877760796553984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 130us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772513.985851:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1790772513.988297:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772514.005620:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796554240 00000100:00100000:3.0:1790772514.005638:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796554240 00000100:00100000:1.0:1790772514.005770:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813367168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772514.005920:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772514.006061:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813367168 00000100:00100000:1.0:1790772514.006069:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813367168 00000100:00100000:1.0:1790772514.006138:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772514.006151:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813367168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772514.006202:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772514.006269:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813367168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772514.006281:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772514.006936:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813367168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772514.014641:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1790772514.014658:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10284:x1877760796554240:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772514.014682:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772514.014706:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be184c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508b0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.014806:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1853 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.014821:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1853 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.014832:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1853 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772514.014843:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790772514.015099:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be184c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b0 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.015118:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1853 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b0 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.015143:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772514.015146:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790772514.015149:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518800, rc 0) 00000100:00100000:2.0:1790772514.015215:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:10284:x1877760796554240:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 560us (26927us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790772514.015221:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1790772514.043036:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772514.043437:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796554368 00000100:00100000:2.0:1790772514.043454:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796554368 00000100:00100000:2.0:1790772514.043521:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1790772514.043533:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796554368:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:2.0:1790772514.043585:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.043611:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.043636:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772514.043640:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772514.043644:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.043683:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.043698:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 7 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.043732:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf568380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1877760813367296:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772514.043847:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b971ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772514.052114:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf568380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1877760813367296:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772514.052160:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772514.052232:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772514.052356:0:6709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796554496 00000100:00100000:2.0:1790772514.052384:0:6709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796554496 00002000:00100000:2.0:1790772514.052447:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9328bfc05f80 x1877760796554496/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:105/0 lens 504/0 e 0 to 0 dl 1790772525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772514.052459:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328bfc05f80 with x1877760796554496 ext(0->12) 00010000:00010000:2.0:1790772514.052472:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 8 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.052493:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 8 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772514.052502:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9328bfc05f80 00000100:00100000:2.0:1790772514.052540:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1790772514.052552:0:6709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2356:x1877760796554496:12345-192.168.201.34@tcp:4:lfs.0 00000001:00080000:1.0:1790772514.069277:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967315 is committed 00000001:00100000:1.0:1790772514.078332:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000100:00100000:3.0:1790772514.117505:0:6709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2356:x1877760796554496:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 64946us (65263us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790772514.117524:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:3.0:1790772514.117539:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9328bfc05f80 x1877760796554496/t4294967299(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:105/0 lens 504/448 e 0 to 0 dl 1790772525 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772514.117550:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328bfc05f80 with x1877760796554496 ext(0->12) 00010000:00010000:3.0:1790772514.117560:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 9 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.117580:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 9 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772514.117587:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9328bfc05f80 00000100:00100000:2.0:1790772514.123687:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772514.123856:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796554624 00000100:00100000:3.0:1790772514.123867:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796554624 00010000:00010000:3.0:1790772514.123927:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 9 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.123976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1790772514.123986:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796554624:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772514.124016:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790772514.124040:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790772514.124070:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790772514 00002000:00010000:3.0:1790772514.124073:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790772514 00002000:00010000:3.0:1790772514.124075:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790772514 00010000:00010000:3.0:1790772514.124084:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 9 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.124101:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 9 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.124133:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1814 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50894 expref: 9 pid: 6704 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.124156:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772514.124160:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772514.124167:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.124178:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.124221:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772514.124287:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796554624:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 302us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.124295:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00010000:00010000:2.0:1790772514.124781:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124793:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124821:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124837:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124845:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124852:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772514.124857:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124866:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124909:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.124918:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009322c8a6/0xd3c7635991be1861 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.124993:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796554368:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 81461us (81973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772514.125010:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1790772514.142860:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.143099:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796554880 00000100:00100000:0.0:1790772514.143111:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796554880 00000100:00100000:0.0:1790772514.143175:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1790772514.143186:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10284:x1877760796554880:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:0.0:1790772514.143252:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1853 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b0 expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772514.146441:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1790772514.146605:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1790772514.147386:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1790772514.147456:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.147487:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 17 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.147496:0:5858:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.147536:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 17 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.147552:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 17 pid: 8380 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.147567:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5858:1877760813367424:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772514.148113:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772514.159089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.159263:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5858:1877760813367424:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772514.159292:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.160492:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796555008 00000100:00100000:3.0:1790772514.160503:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796555008 00010000:00010000:3.0:1790772514.160554:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 18 pid: 8380 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.160621:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1790772514.160632:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:2354:x1877760796555008:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772514.160648:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772514.160655:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 18 pid: 8380 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.160667:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 18 pid: 8380 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.160693:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be17f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50886 expref: 18 pid: 8380 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.160711:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772514.160717:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.160726:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.160733:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.160759:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772514.160823:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:2354:x1877760796555008:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 192us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.160829:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00010000:00010000:0.0:1790772514.161076:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.161083:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772514.161218:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1790772514.161461:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1790772514.161607:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813367552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790772514.161711:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772514.161751:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772514.161924:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813367552 00000100:00100000:3.0:1790772514.161937:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813367552 00000100:00100000:3.0:1790772514.161974:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772514.161982:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1877760813367552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790772514.162082:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1877760813367552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.162090:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772514.162251:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813367552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772514.162944:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1790772514.163024:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf56a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813367680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790772514.163070:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772514.163222:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813367680 00000100:00100000:3.0:1790772514.163228:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813367680 00000100:00100000:3.0:1790772514.163286:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772514.163294:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1877760813367680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790772514.163490:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1877760813367680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 197us (419us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790772514.163498:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772514.163691:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0b6c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772514.163721:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf56a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813367680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790772514.163779:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1790772514.163820:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.163831:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.163839:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.163845:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.163850:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.163858:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.163906:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772514.163910:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790772514.163915:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.163922:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1868 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772514.164140:0:5858:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790772514.164453:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790772514.164477:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334984601142ns, next at 335984599387ns, rc = 0 00000001:00080000:0.0:1790772514.164484:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1790772514.164518:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772514.164521:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790772514.164529:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1853 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b0 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.164645:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:10284:x1877760796554880:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 21461us (21797us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790772514.164654:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000020:00080000:0.0:1790772514.164658:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790772514.174799:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.174986:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796555136 00000100:00100000:0.0:1790772514.175007:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796555136 00000100:00100000:0.0:1790772514.175072:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1790772514.175083:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:10284:x1877760796555136:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772514.175112:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772514.175138:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be186f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508b7 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.175204:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be186f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b7 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.175219:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be186f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b7 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.175238:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772514.175241:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772514.175245:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92c00, rc 0) 00000100:00100000:0.0:1790772514.175348:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10284:x1877760796555136:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 267us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.175355:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:2.0:1790772514.198549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772514.198620:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796555392 00000100:00100000:1.0:1790772514.198631:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796555392 00000100:00100000:1.0:1790772514.198694:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1790772514.198707:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10284:x1877760796555392:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772514.199035:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:10284:x1877760796555392:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 329us (499us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1790772514.199043:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772514.331662:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.331788:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796555648 00000100:00100000:0.0:1790772514.331799:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796555648 00000100:00100000:0.0:1790772514.331862:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1790772514.331871:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:10294:x1877760796555648:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772514.331939:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772514.331960:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508be expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772514.332105:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790772514.332246:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1876 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508be expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.332261:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772514.332264:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772514.332269:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508be expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.332284:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772514.332474:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10294:x1877760796555648:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 603us (822us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1790772514.332483:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1790772514.337028:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.337565:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796555776 00000100:00100000:0.0:1790772514.337577:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796555776 00000100:00100000:0.0:1790772514.337643:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:0.0:1790772514.337653:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10294:x1877760796555776:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1790772514.337750:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.337781:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.337797:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.337815:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.337823:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.337831:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338101:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338111:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338117:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772514.338161:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338174:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338190:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338197:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338203:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.338207:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338215:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338228:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772514.338231:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772514.338236:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338241:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.338253:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339506:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339516:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339522:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.339540:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339550:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339562:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8f00) 00010000:00010000:0.0:1790772514.339566:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772514.339570:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339577:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be188b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339600:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339606:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339612:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339618:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.339621:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339627:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339635:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772514.339637:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772514.339651:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.339657:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.339979:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10294:x1877760796555776:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 2321us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772514.340003:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1790772514.343535:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772514.343639:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796556032 00000100:00100000:1.0:1790772514.343651:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796556032 00000100:00100000:1.0:1790772514.343747:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1790772514.343758:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10294:x1877760796556032:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772514.344058:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:10294:x1877760796556032:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 301us (532us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1790772514.344066:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1790772514.386384:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.386546:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796556288 00000100:00100000:0.0:1790772514.386558:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796556288 00000100:00100000:0.0:1790772514.386685:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1790772514.386696:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:10297:x1877760796556288:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772514.386721:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772514.386746:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508c5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.386827:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.386842:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.386852:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.386866:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.386872:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.386944:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387201:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387210:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387218:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772514.387228:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790772514.387325:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387334:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387341:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387347:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.387351:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387358:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387370:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772514.387373:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772514.387385:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387391:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be18a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387403:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387409:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387414:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387419:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.387421:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387426:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387434:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8f00) 00010000:00010000:0.0:1790772514.387436:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772514.387439:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387444:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387486:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 27 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387511:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.387517:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772514.387520:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772514.387522:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772514.387594:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10297:x1877760796556288:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 899us (1218us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1790772514.387602:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1790772514.390864:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772514.391150:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796556416 00000100:00100000:3.0:1790772514.391162:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796556416 00000100:00100000:3.0:1790772514.391230:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1790772514.391242:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10297:x1877760796556416:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1790772514.391316:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391334:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391347:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391551:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391574:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391582:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391589:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772514.391593:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391601:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391613:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772514.391616:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772514.391621:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.391627:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be18bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.391798:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10297:x1877760796556416:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 558us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.391807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1790772514.395444:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.395561:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796556672 00000100:00100000:0.0:1790772514.395572:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796556672 00000100:00100000:0.0:1790772514.395617:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1790772514.395624:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10297:x1877760796556672:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772514.395818:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:10297:x1877760796556672:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 193us (384us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790772514.395825:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00010000:00010000:2.0:1790772514.571068:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772514.836164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772514.836293:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796556928 00000100:00100000:1.0:1790772514.836303:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796556928 00000100:00100000:1.0:1790772514.836371:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1790772514.836382:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:10328:x1877760796556928:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:1.0:1790772514.836408:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772514.836429:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be18c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508cc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.836528:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be18ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.836544:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be18ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.836576:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be18ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772514.836589:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790772514.836966:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be18c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508cc expref: 30 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.836998:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be18ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508cc expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772514.837007:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:1.0:1790772514.837010:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772514.837014:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db600, rc 0) 00000100:00100000:1.0:1790772514.837152:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10328:x1877760796556928:12345-192.168.201.34@tcp:101:cat.0 Request processed in 772us (1000us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1790772514.837161:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1790772514.847171:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772514.847288:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772514.847391:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796557056 00000100:00100000:3.0:1790772514.847401:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796557056 00000100:00100000:3.0:1790772514.847469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1790772514.847479:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:2355:x1877760796557056:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772514.847505:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772514.847529:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be18ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508cc expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.847548:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772514.847553:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772514.847614:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:2355:x1877760796557056:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 136us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.847621:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1790772514.852776:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796557312 00000100:00100000:0.0:1790772514.852792:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796557312 00000100:00100000:0.0:1790772514.853509:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1790772514.853524:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:10328:x1877760796557312:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1790772514.854016:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10328:x1877760796557312:12345-192.168.201.34@tcp:35:cat.0 Request processed in 495us (6853us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1790772514.854025:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1790772514.958276:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772514.958601:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796557568 00000100:00100000:0.0:1790772514.958635:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796557568 00000100:00100000:0.0:1790772514.958795:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1790772514.958807:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10334:x1877760796557568:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1790772514.958843:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772514.958847:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772514.958956:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508a2 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.959003:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772514.959009:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772514.959095:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be18d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508d3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.959237:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.959256:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.959266:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.959308:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.959323:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 29 pid: 5857 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.959342:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813367808:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772514.959637:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9894000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772514.972435:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772514.972834:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796557696 00000100:00100000:3.0:1790772514.972849:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796557696 00010000:00010000:3.0:1790772514.972942:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 30 pid: 5857 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772514.972999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:3.0:1790772514.973020:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:2355:x1877760796557696:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772514.973049:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772514.973058:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 30 pid: 5857 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.973073:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 30 pid: 5857 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.973103:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772514.973110:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.973145:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.973154:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772514.973180:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772514.973258:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:2355:x1877760796557696:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 248us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772514.973266:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00010000:00010000:0.0:1790772514.973819:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be18ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508c5 expref: 29 pid: 5857 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772514.973842:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813367808:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772514.973890:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.973902:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.973908:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772514.973944:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790772514.974210:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be18d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 30 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.974229:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.974238:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772514.974241:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772514.974244:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93c00, rc 0) 00000100:00100000:0.0:1790772514.974293:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10334:x1877760796557568:12345-192.168.201.34@tcp:101:dd.0 Request processed in 15488us (16033us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790772514.974302:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1790772514.983621:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772514.984158:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796557952 00000100:00100000:2.0:1790772514.984175:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796557952 00000100:00100000:2.0:1790772514.984252:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1790772514.984266:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10334:x1877760796557952:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1790772514.984819:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.984843:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772514.984858:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772514.984963:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1790772514.985448:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d0f5de70 reply state 00000000a775fd60 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772514.985462:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772514.985782:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:10334:x1877760796557952:12345-192.168.201.34@tcp:36:dd.0 Request processed in 1515us (2314us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1790772514.985792:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000020:00080000:2.0:1790772514.985799:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772514.992546:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.992590:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.992599:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.992606:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772514.992612:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.992621:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.992643:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772514.992647:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772514.992654:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772514.992661:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be18ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772515.355726:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772515.356732:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796558080 00000100:00100000:2.0:1790772515.356759:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796558080 00000100:00080000:1.0:1790772515.356847:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772515.356866:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1790772515.356924:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:10348:x1877760796558080:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:2.0:1790772515.356961:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772515.356998:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be18f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508da expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.359536:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.359570:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.359588:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.359612:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.359619:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.359655:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.361425:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.361453:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.361462:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.361518:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.361541:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 32 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772515.361561:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813367936:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772515.361732:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0b6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772515.365249:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813367936:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772515.365296:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772515.371004:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772515.375235:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796558336 00000100:00100000:1.0:1790772515.375260:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796558336 00000100:00100000:1.0:1790772515.375441:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772515.375455:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:5594:x1877760796558336:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790772515.376923:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:5594:x1877760796558336:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 1461us (5924us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1790772515.376937:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772515.390472:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772515.390950:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796558464 00000100:00100000:0.0:1790772515.390966:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796558464 00010000:00010000:0.0:1790772515.391048:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 34 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772515.391104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1790772515.391116:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:2354:x1877760796558464:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772515.391138:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772515.391168:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 34 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.391185:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 34 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.391214:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be18df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508d3 expref: 34 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.391235:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772515.391242:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.391255:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.391265:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.391308:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772515.391409:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:2354:x1877760796558464:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 294us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772515.391416:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00010000:00010000:2.0:1790772515.392193:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392209:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772515.392531:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790772515.392537:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772515.392601:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392619:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392631:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392639:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392648:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392655:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772515.392660:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392670:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392685:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772515.392689:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772515.392694:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392701:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be18fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392731:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392739:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392746:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392752:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772515.392755:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392762:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392771:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a1803200) 00010000:00010000:2.0:1790772515.392773:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772515.392777:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392784:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392840:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be18f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508da expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.392856:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508da expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.394016:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:2.0:1790772515.394021:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772515.394027:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518800, rc 0) 00000100:00100000:2.0:1790772515.395611:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:10348:x1877760796558080:12345-192.168.201.34@tcp:101:stat.0 Request processed in 38719us (39885us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772515.395626:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1790772515.561604:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772515.561801:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796558720 00000100:00100000:0.0:1790772515.561811:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796558720 00000100:00100000:1.0:1790772515.563074:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1790772515.563095:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:10354:x1877760796558720:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:1.0:1790772515.563184:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772515.563218:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508da expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772515.563240:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:1.0:1790772515.563245:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772515.563752:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772515.563771:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772515.563781:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772515.563839:0:8380:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1790772515.563866:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000112868de reply state 00000000041eb403 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772515.564068:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772515.565518:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:10354:x1877760796558720:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 2422us (3914us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1790772515.565531:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000020:00080000:1.0:1790772515.565540:0:8380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790772515.579189:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.579217:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.579227:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.579233:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772515.579240:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.579249:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.579273:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772515.579298:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772515.579305:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.579313:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1910 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772515.595193:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772515.814088:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772515.814213:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796558848 00000100:00100000:0.0:1790772515.814241:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796558848 00000100:00100000:0.0:1790772515.814337:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1790772515.814349:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:10368:x1877760796558848:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:0.0:1790772515.814378:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772515.814421:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1917 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508e1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814493:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814507:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814520:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814535:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814542:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814549:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814797:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814808:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814815:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772515.814848:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1790772515.814853:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772515.814927:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814947:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814956:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814962:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814978:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.814985:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772515.814998:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815007:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815018:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772515.815021:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772515.815025:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815031:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be191e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815043:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815049:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815062:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815067:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772515.815069:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815075:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815082:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8f00) 00010000:00010000:0.0:1790772515.815085:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772515.815087:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815093:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815125:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1917 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815140:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772515.815147:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772515.815149:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772515.815151:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772515.815234:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:10368:x1877760796558848:12345-192.168.201.34@tcp:101:stat.0 Request processed in 886us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772515.815250:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1790772515.943700:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772515.943918:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796559104 00000100:00100000:2.0:1790772515.943933:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796559104 00000100:00100000:2.0:1790772515.944042:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1790772515.944053:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:10378:x1877760796559104:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772515.944076:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772515.944099:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508e8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772515.944195:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790772515.944739:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1933 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e8 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.944755:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:2.0:1790772515.944758:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772515.944763:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e8 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772515.944778:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519c00, rc 0) 00000100:00100000:2.0:1790772515.944961:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:10378:x1877760796559104:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 910us (1272us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1790772515.944995:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:1.0:1790772515.949449:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772515.949506:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796559360 00000100:00100000:0.0:1790772515.949518:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796559360 00000100:00100000:0.0:1790772515.949585:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1790772515.949595:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:10378:x1877760796559360:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772515.950525:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:10378:x1877760796559360:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 924us (1079us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790772515.950537:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1790772516.025136:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772516.025402:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796559616 00000100:00100000:0.0:1790772516.025415:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796559616 00000100:00100000:0.0:1790772516.025486:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1790772516.025497:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:10384:x1877760796559616:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772516.025525:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772516.025549:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1941 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508ef expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.025670:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.025686:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.025695:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.025734:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.025765:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 37 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772516.025780:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813368064:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772516.025922:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9894840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772516.031091:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813368064:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772516.031125:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772516.032373:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772516.032541:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796559744 00000100:00100000:3.0:1790772516.032549:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796559744 00010000:00010000:3.0:1790772516.032584:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 38 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772516.032616:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1790772516.032623:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:2354:x1877760796559744:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772516.032634:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772516.032640:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 38 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.032650:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 38 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.032667:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be192c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508e1 expref: 38 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.032680:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772516.032685:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.032692:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.032704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.032728:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772516.032775:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.032783:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772516.032795:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:2354:x1877760796559744:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 172us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772516.032802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000004:00200000:0.0:1790772516.032803:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790772516.034788:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1941 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.034814:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.034823:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772516.034826:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772516.034829:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93e00, rc 0) 00000100:00100000:0.0:1790772516.034971:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:10384:x1877760796559616:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9416us (9785us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1790772516.034995:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1790772516.042773:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.042904:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796560000 00000100:00100000:2.0:1790772516.042917:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796560000 00000100:00100000:2.0:1790772516.042992:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1790772516.043002:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:10384:x1877760796560000:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1790772516.043284:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.043301:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.043313:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772516.043380:0:8380:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1790772516.043406:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000023eadd35 reply state 000000001db5cc59 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772516.043415:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772516.043497:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:10384:x1877760796560000:12345-192.168.201.34@tcp:36:bash.0 Request processed in 495us (734us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1790772516.043505:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000020:00080000:2.0:1790772516.043511:0:8380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772516.049042:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.049061:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.049068:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.049074:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772516.049079:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.049087:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.049105:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772516.049108:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772516.049113:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.049120:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772516.050488:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.055570:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796560128 00000100:00100000:2.0:1790772516.055583:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796560128 00000100:00100000:2.0:1790772516.055653:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:2.0:1790772516.055664:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:10384:x1877760796560128:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772516.055693:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772516.055727:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be195d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508f6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.055823:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.055838:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.055848:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.055910:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.055923:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 40 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772516.055936:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813368192:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772516.056032:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0b6ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772516.063463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772516.063601:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796560256 00000100:00100000:0.0:1790772516.063610:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796560256 00010000:00010000:0.0:1790772516.063643:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 41 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772516.063679:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:0.0:1790772516.063701:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:2354:x1877760796560256:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772516.063715:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772516.063720:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 41 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.063730:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 41 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.063747:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772516.063752:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.063759:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.063765:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.063781:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772516.063834:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:2354:x1877760796560256:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 132us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772516.063841:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00010000:00010000:2.0:1790772516.064071:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1948 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508ef expref: 40 pid: 5857 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772516.064090:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813368192:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772516.064113:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.064121:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.064138:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772516.064202:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790772516.064207:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772516.064237:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.064272:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be195d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508f6 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.064288:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508f6 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.064296:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:2.0:1790772516.064298:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772516.064301:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518000, rc 0) 00000100:00100000:2.0:1790772516.064329:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:10384:x1877760796560128:12345-192.168.201.34@tcp:101:bash.0 Request processed in 8667us (13848us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772516.064336:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1790772516.070801:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.070859:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796560512 00000100:00100000:2.0:1790772516.070870:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796560512 00000100:00100000:2.0:1790772516.071039:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1790772516.071050:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:10384:x1877760796560512:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1790772516.071366:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:10384:x1877760796560512:12345-192.168.201.34@tcp:35:bash.0 Request processed in 316us (573us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1790772516.071375:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1790772516.186783:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.186926:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796560768 00000100:00100000:2.0:1790772516.186937:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796560768 00000100:00100000:2.0:1790772516.187005:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1790772516.187015:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:10394:x1877760796560768:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772516.187053:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772516.187074:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be196b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a508fd expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772516.187195:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790772516.187336:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be196b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508fd expref: 42 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.187351:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:2.0:1790772516.187354:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772516.187359:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be196b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508fd expref: 42 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.187374:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519200, rc 0) 00000100:00100000:2.0:1790772516.187639:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:10394:x1877760796560768:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 624us (865us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790772516.187648:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1790772516.194280:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772516.194383:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796560896 00000100:00100000:0.0:1790772516.194393:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796560896 00000100:00100000:0.0:1790772516.194454:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1790772516.194465:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:10394:x1877760796560896:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1790772516.194551:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.194587:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.194600:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.194617:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.194624:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.194630:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199177:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199200:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199212:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772516.199267:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199281:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199288:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199309:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199315:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772516.199319:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199326:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199338:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772516.199342:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772516.199346:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199352:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199366:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199372:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199377:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199382:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772516.199386:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199402:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199410:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8f00) 00010000:00010000:0.0:1790772516.199413:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772516.199416:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199421:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199436:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199443:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199450:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199455:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772516.199457:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199463:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199470:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772516.199472:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772516.199475:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.199490:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772516.199641:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:10394:x1877760796560896:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 5174us (5366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772516.199652:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1790772516.204696:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772516.204810:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796561152 00000100:00100000:0.0:1790772516.204822:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796561152 00000100:00100000:0.0:1790772516.204947:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1790772516.204969:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:10394:x1877760796561152:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772516.205230:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:10394:x1877760796561152:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 272us (546us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1790772516.205238:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1790772516.245472:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772516.245567:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796561408 00000100:00100000:1.0:1790772516.245578:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796561408 00000100:00100000:1.0:1790772516.245694:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1790772516.245705:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:10397:x1877760796561408:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772516.245731:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772516.245752:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be198e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50904 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.245831:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.245847:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.245857:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246437:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246451:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246460:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246742:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be19a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246752:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be19a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246768:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be19a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772516.246779:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790772516.246871:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.246907:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247323:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247384:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772516.247389:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247398:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247410:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772516.247413:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772516.247418:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247424:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247438:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247444:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247458:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247462:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772516.247465:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247472:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247480:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a16c3a00) 00010000:00010000:1.0:1790772516.247483:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772516.247486:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247491:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be199c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247543:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be198e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50904 expref: 45 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247558:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be19a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50904 expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.247566:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:1.0:1790772516.247568:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772516.247570:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db800, rc 0) 00000100:00100000:1.0:1790772516.247704:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:10397:x1877760796561408:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2000us (2241us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790772516.247721:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1790772516.252569:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772516.252617:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.252717:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796561536 00000100:00100000:2.0:1790772516.252727:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796561536 00000100:00100000:2.0:1790772516.252791:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1790772516.252801:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:10397:x1877760796561536:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1790772516.252896:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.252949:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.252970:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.252997:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.253012:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.253021:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.253027:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772516.253031:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.253039:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.253051:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:2.0:1790772516.253054:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772516.253059:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.253065:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772516.253139:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:10397:x1877760796561536:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 339us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772516.253153:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1790772516.256527:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772516.256794:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796561920 00000100:00100000:1.0:1790772516.256805:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796561920 00000100:00100000:1.0:1790772516.256866:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1790772516.256901:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:10397:x1877760796561920:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772516.257686:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10397:x1877760796561920:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 808us (1165us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1790772516.257695:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1790772516.257861:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796561664 00000100:00100000:0.0:1790772516.257868:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796561664 00000100:00100000:0.0:1790772516.257947:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1790772516.257956:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:2355:x1877760796561664:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772516.258987:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772516.259026:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be19a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50904 expref: 45 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.259047:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772516.259052:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772516.259098:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:2355:x1877760796561664:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1143us (6480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772516.259121:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1790772516.412733:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772516.412919:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796562176 00000100:00100000:1.0:1790772516.412931:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796562176 00000100:00100000:1.0:1790772516.412998:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1790772516.413008:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:10415:x1877760796562176:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:1.0:1790772516.413036:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772516.413057:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be19b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5090b expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.413140:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be19bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.413152:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be19bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.413163:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be19bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772516.413185:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790772516.413433:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be19b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5090b expref: 47 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.413466:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be19bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5090b expref: 46 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772516.413473:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:1.0:1790772516.413475:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772516.413477:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dac00, rc 0) 00000100:00100000:1.0:1790772516.413529:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10415:x1877760796562176:12345-192.168.201.34@tcp:101:cat.0 Request processed in 524us (804us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1790772516.413534:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1790772516.456716:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.456810:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796562304 00000100:00100000:2.0:1790772516.456819:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796562304 00000100:00100000:2.0:1790772516.456871:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:2.0:1790772516.456912:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10416:x1877760796562304:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772516.456942:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772516.456970:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50912 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.457035:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be19d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.457048:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be19d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.457059:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be19d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772516.457092:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790772516.457095:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772516.457112:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be19d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.457134:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50912 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.457163:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be19d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50912 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.457190:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772516.457193:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772516.457197:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519800, rc 0) 00000100:00100000:2.0:1790772516.457258:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10416:x1877760796562304:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 347us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772516.457265:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1790772516.469107:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.469303:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796562688 00000100:00100000:2.0:1790772516.469317:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796562688 00000100:00100000:2.0:1790772516.469394:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1790772516.469405:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10416:x1877760796562688:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1790772516.469920:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:10416:x1877760796562688:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 514us (828us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790772516.469930:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1790772516.478994:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772516.479120:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796562816 00000100:00100000:0.0:1790772516.479135:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796562816 00000100:00100000:0.0:1790772516.479300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1790772516.479312:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:10416:x1877760796562816:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:0.0:1790772516.479334:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790772516.479368:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508f6 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.479399:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be19bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5090b expref: 47 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.479413:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be186f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a508b7 expref: 46 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772516.479424:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772516.479440:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772516.479640:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10416:x1877760796562816:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 328us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772516.479650:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772516.493040:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.495135:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796562944 00000100:00100000:2.0:1790772516.495228:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796562944 00000100:00100000:2.0:1790772516.495328:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1790772516.495341:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10416:x1877760796562944:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:2.0:1790772516.495532:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.495555:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772516.495571:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772516.498399:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772516.498648:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790772516.498737:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790772516.498965:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10416:x1877760796562944:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 3609us (5925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772516.498982:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1790772516.548497:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772516.548629:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796563072 00000100:00100000:2.0:1790772516.548644:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796563072 00000100:00100000:2.0:1790772516.548726:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1790772516.548736:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10418:x1877760796563072:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772516.548764:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772516.548791:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be19e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50919 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549359:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549381:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549420:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549441:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549449:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549456:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549769:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549779:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549786:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772516.549838:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790772516.549843:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772516.549870:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549915:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549925:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549943:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549951:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549968:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772516.549973:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549982:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.549997:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:3.0:1790772516.550011:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772516.550018:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550025:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be19e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550050:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550056:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550062:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550067:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772516.550077:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550085:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550094:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff932884f65100) 00010000:00010000:3.0:1790772516.550097:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772516.550100:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.550106:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be19f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.552585:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be19e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.552635:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772516.552646:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:3.0:1790772516.552649:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772516.552653:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8c00, rc 0) 00000100:00100000:3.0:1790772516.553023:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10418:x1877760796563072:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 4284us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772516.553034:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:2.0:1790772516.621827:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772517.024806:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772517.024822:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772517.024928:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790772517.024938:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772517.026702:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813368320:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772517.026897:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a16530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772517.050626:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813368320:192.168.201.34@tcp:107:hsm_cdtr.0 00000004:00080000:2.0:1790772517.069234:0:6990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337889354265ns, next at 338889350245ns, rc = 0 00000100:00100000:3.0:1790772517.071292:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813368448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772517.071439:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772517.072128:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813368448 00000100:00100000:2.0:1790772517.072141:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813368448 00000100:00100000:2.0:1790772517.072216:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790772517.072229:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813368448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772517.072286:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772517.072355:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813368448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772517.072363:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1790772517.073309:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772517.073401:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813368448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772517.074825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.083397:0:5866:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796563200 00000100:00100000:2.0:1790772517.083420:0:5866:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796563200 00000100:00100000:3.0:1790772517.084978:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1790772517.085005:0:5866:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563200:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790772517.085164:0:5866:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563200:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 173us (10349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.085173:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00080000:1.0:1790772517.086704:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772517.097717:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.106617:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796563328 00000100:00100000:1.0:1790772517.106642:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796563328 00000100:00100000:1.0:1790772517.106748:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1790772517.106762:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563328:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790772517.106809:0:8380:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790772517.109554:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563328:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 2775us (11832us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772517.109573:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1790772517.118854:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.132226:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796563456 00000100:00100000:1.0:1790772517.132265:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796563456 00000100:00100000:0.0:1790772517.133378:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1790772517.133393:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563456:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790772517.133497:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133530:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133544:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133565:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133573:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133580:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133614:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133623:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133629:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772517.133678:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790772517.133683:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772517.133700:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133714:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133731:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133739:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133746:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772517.133751:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133760:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133774:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:0.0:1790772517.133777:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772517.133782:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133788:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be19fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133803:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133809:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133815:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133821:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772517.133830:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133836:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133845:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9328946b8200) 00010000:00010000:0.0:1790772517.133847:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772517.133850:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133856:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1a05 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133911:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133918:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133924:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133930:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772517.133933:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133939:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133959:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:0.0:1790772517.133962:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772517.133971:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.133977:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772517.134121:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563456:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 718us (15271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772517.134133:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:2.0:1790772517.156473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.156572:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796563712 00000100:00100000:1.0:1790772517.156586:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796563712 00000100:00100000:1.0:1790772517.156660:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:1.0:1790772517.156671:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10429:x1877760796563712:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.156700:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772517.156726:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50920 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.156905:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.156927:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.156942:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772517.156966:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790772517.157127:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157137:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157145:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157152:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.157157:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157189:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157206:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:1.0:1790772517.157210:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772517.157216:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157223:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157286:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a13 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50920 expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157298:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:1.0:1790772517.157300:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772517.157304:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50920 expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.157314:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772517.157413:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10429:x1877760796563712:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 743us (955us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1790772517.157422:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1790772517.173529:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.173626:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796563840 00000100:00100000:1.0:1790772517.173640:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796563840 00000100:00100000:1.0:1790772517.173710:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1790772517.173721:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10429:x1877760796563840:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790772517.173787:0:5857:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790772517.174348:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10429:x1877760796563840:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 625us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772517.174358:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1790772517.185393:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.185499:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796564096 00000100:00100000:1.0:1790772517.185511:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796564096 00000100:00100000:1.0:1790772517.185587:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:1.0:1790772517.185598:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10429:x1877760796564096:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.185626:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772517.185630:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790772517.185668:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be19d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50912 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.185691:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772517.185697:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772517.185713:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50927 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790772517.186458:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790772517.186670:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.186686:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.186697:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.186775:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50927 expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.186792:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50927 expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.186800:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772517.186803:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772517.186805:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dae00, rc 0) 00000100:00100000:1.0:1790772517.186918:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:10429:x1877760796564096:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1322us (1538us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790772517.186927:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:2.0:1790772517.195236:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.195384:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796564352 00000100:00100000:1.0:1790772517.195398:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796564352 00000100:00100000:1.0:1790772517.195478:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:1.0:1790772517.195490:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:10429:x1877760796564352:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.195598:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772517.195632:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50927 expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.195654:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772517.195667:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772517.195694:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.195710:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.195727:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198079:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198106:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198120:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198352:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198360:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198367:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.198373:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.198377:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199519:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199536:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772517.199539:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772517.199544:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199563:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199580:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199586:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199592:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199598:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.199601:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199608:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199616:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x74873cb5 (ffff9328a16c3000) 00010000:00010000:1.0:1790772517.199619:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772517.199622:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.199628:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x74873cb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.199749:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10429:x1877760796564352:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 4257us (4524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772517.199759:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:3.0:1790772517.208617:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.208780:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796564480 00000100:00100000:1.0:1790772517.209284:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796564480 00000100:00100000:1.0:1790772517.209353:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1790772517.209362:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10429:x1877760796564480:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.209396:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772517.209422:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5092e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.209496:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.209511:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.209523:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.209627:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.209650:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.209661:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:1.0:1790772517.209663:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772517.209667:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db800, rc 0) 00000100:00100000:1.0:1790772517.209754:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:10429:x1877760796564480:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 392us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772517.209763:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:3.0:1790772517.222718:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.222794:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796564736 00000100:00100000:2.0:1790772517.222811:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796564736 00000100:00100000:2.0:1790772517.222912:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:2.0:1790772517.222923:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:10429:x1877760796564736:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772517.223152:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.223170:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.223183:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772517.224094:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1790772517.224116:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338044239782ns, next at 339044235567ns, rc = 0 00000004:00010000:3.0:1790772517.224243:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad112d59 reply state 00000000cee6fcbd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.224255:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772517.224390:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:10429:x1877760796564736:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1465us (1684us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1790772517.224399:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:3.0:1790772517.226630:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.226647:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.226656:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.226680:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772517.226685:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.226693:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.226709:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:3.0:1790772517.226714:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772517.226718:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.226725:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.226909:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.227058:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796564864 00000100:00100000:3.0:1790772517.227069:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796564864 00000100:00100000:3.0:1790772517.227127:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:3.0:1790772517.227139:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:10429:x1877760796564864:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772517.227167:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772517.227182:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50935 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.227240:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 50 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.227253:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 50 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.227283:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:3.0:1790772517.227286:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790772517.227289:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9400, rc 0) 00000100:00100000:3.0:1790772517.227352:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:10429:x1877760796564864:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 216us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.227359:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1790772517.233157:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772517.233213:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796564992 00000100:00100000:0.0:1790772517.233224:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796564992 00000100:00100000:0.0:1790772517.233273:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1790772517.233280:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1877760796564992:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790772517.233312:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:0.0:1790772517.233342:0:6704:0:(genops.c:1384:class_connect()) connect: client 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677, cookie 0xd3c7635991be1a67 00002000:00100000:0.0:1790772517.233364:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677/ffff93288694f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772517.233389:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790772517.233680:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790772517.233714:0:6704:0:(import.c:65:import_set_state_nolock()) ffff93288694a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772517.233801:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2353:x1877760796564992:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 Request processed in 510us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772517.233809:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1790772517.237511:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.241389:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796565120 00000100:00100000:2.0:1790772517.241411:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796565120 00000100:00100000:2.0:1790772517.241575:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1790772517.241589:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:0:x1877760796565120:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790772517.245471:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1790772517.302337:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000001:00080000:0.0:1790772517.302357:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1790772517.306813:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:0:x1877760796565120:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 65214us (69303us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790772517.306827:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1790772517.315731:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.315787:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796565376 00000100:00100000:2.0:1790772517.315800:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796565376 00000100:00100000:2.0:1790772517.315867:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1790772517.315902:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:10429:x1877760796565376:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790772517.316405:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:10429:x1877760796565376:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 527us (680us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1790772517.316414:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1790772517.327284:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.327423:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796565632 00000100:00100000:3.0:1790772517.327433:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796565632 00000100:00100000:3.0:1790772517.327489:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:3.0:1790772517.327499:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:10429:x1877760796565632:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790772517.327610:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:10429:x1877760796565632:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 113us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.327618:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1790772517.331610:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.332159:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796565760 00000100:00100000:2.0:1790772517.332185:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796565760 00000100:00100000:2.0:1790772517.332263:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:2.0:1790772517.332274:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:10429:x1877760796565760:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772517.332298:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772517.332319:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5093c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.332395:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be1a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.332410:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be1a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.332422:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be1a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772517.332466:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772517.332488:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be1a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.332516:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5093c expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.333494:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be1a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5093c expref: 52 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.333505:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:2.0:1790772517.333508:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790772517.333513:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519600, rc 0) 00000100:00100000:2.0:1790772517.333788:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10429:x1877760796565760:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1504us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772517.333807:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:1.0:1790772517.340222:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.340315:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796565888 00000100:00100000:3.0:1790772517.340325:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796565888 00000100:00100000:3.0:1790772517.340388:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1790772517.340399:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796565888:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772517.340418:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772517.340442:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50943 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772517.340491:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd0525, blocks: 0x1 00010000:00010000:3.0:1790772517.340511:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1790772517.340516:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772517.340525:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.340544:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.340557:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9200, rc 0) 00000100:00100000:3.0:1790772517.340632:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796565888:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 234us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.340639:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1790772517.344950:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.345160:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796566144 00000100:00100000:2.0:1790772517.345170:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796566144 00000100:00100000:2.0:1790772517.345222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:2.0:1790772517.345232:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10429:x1877760796566144:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790772517.345334:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10429:x1877760796566144:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772517.345342:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:0.0:1790772517.356490:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.357365:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796566272 00000100:00100000:1.0:1790772517.357378:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796566272 00000100:00100000:1.0:1790772517.357428:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1790772517.357438:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:10429:x1877760796566272:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.357458:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772517.357476:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5094a expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.357505:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.357515:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772517.357519:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772517.357524:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.357566:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.357591:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 7 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.357622:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1877760813368576:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772517.357720:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a16530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772517.364799:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.364830:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796566400 00000100:00100000:2.0:1790772517.364841:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796566400 00010000:00010000:2.0:1790772517.364905:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 8 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772517.364956:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1790772517.364966:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796566400:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772517.364981:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772517.365287:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 8 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.365303:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 8 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.365333:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772517.365351:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772517.365360:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.365372:0:5841:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.365410:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772517.365425:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd89f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5841:1877760813368704:192.168.201.34@tcp:105: 00000100:00100000:2.0:1790772517.365506:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85c00 going to sleep for 11 seconds 00010000:00010000:2.0:1790772517.365558:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c1c7467/0xd3c7635991be1a7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50943 expref: 8 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772517.365574:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1877760813368576:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772517.365599:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.365610:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:2.0:1790772517.365638:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:10429:x1877760796566272:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 8202us (9155us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772517.365645:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1790772517.380676:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd89f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5841:1877760813368704:192.168.201.34@tcp:105: 00010000:00010000:3.0:1790772517.380708:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772517.380777:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796566400:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 15804us (15992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.381038:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1790772517.389464:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.389622:0:6711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796566528 00000100:00100000:1.0:1790772517.389632:0:6711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796566528 00002000:00100000:1.0:1790772517.389683:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9328c0e6e680 x1877760796566528/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:108/0 lens 504/0 e 0 to 0 dl 1790772528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772517.389694:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c0e6e680 with x1877760796566528 ext(0->8) 00002000:00010000:1.0:1790772517.389700:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c0e6e680 00000100:00100000:1.0:1790772517.389774:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1790772517.389796:0:6711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796566528:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790772517.390480:0:6711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796566528:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 694us (1020us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790772517.390490:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:1.0:1790772517.390498:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9328c0e6e680 x1877760796566528/t4294967302(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:108/0 lens 504/448 e 0 to 0 dl 1790772528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772517.390506:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c0e6e680 with x1877760796566528 ext(0->8) 00002000:00010000:1.0:1790772517.390509:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c0e6e680 00000100:00100000:1.0:1790772517.397541:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.397720:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796566656 00000100:00100000:3.0:1790772517.397731:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796566656 00000100:00100000:3.0:1790772517.397786:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1790772517.397796:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10429:x1877760796566656:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790772517.472977:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000004:00080000:3.0:1790772517.473029:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790772517.473065:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1790772517.473089:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1790772517.473095:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1790772517.473114:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9328c0b6c300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1790772517.473120:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bfdac400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9328c0b6c9c0 00000020:00080000:3.0:1790772517.473123:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bfdacb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9328c0e56800 00000004:00080000:3.0:1790772517.473136:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1790772517.473290:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813368832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790772517.473367:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772517.473446:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813368832 00000100:00100000:3.0:1790772517.473453:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813368832 00000100:00100000:3.0:1790772517.473508:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790772517.473517:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813368832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790772517.474098:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790772517.474104:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790772517 00002000:00010000:3.0:1790772517.474107:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790772517.474109:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790772517 -> 1790772517 00002000:00010000:3.0:1790772517.474111:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790772517.474173:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813368832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 656us (805us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790772517.474181:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790772517.474207:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790772517.474249:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328c0e6c000/2, rc 0, transno 4294967303 00000100:00100000:3.0:1790772517.474255:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813368832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790772517.474795:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10429:x1877760796566656:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 76996us (77260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772517.474804:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000020:00080000:1.0:1790772517.474956:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1790772517.475076:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1790772517.475086:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772517.475100:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813368960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790772517.475147:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772517.475199:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813368960 00000100:00100000:1.0:1790772517.475205:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813368960 00000100:00100000:1.0:1790772517.475239:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772517.475247:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1877760813368960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790772517.475271:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1790772517.475441:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abd0522, atime: 0x6abd0522, ctime: 0x6abd0522, blocks: 0x1 00010000:00010000:1.0:1790772517.475451:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.475467:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1790772517.475472:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772517.475479:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.475497:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.475506:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.475514:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.475725:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790772517.476255:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813368960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1006us (1105us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790772517.476264:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1790772517.476318:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93289ee89180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790772517.476324:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813368960:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790772517.480186:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772517.480202:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.480216:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772517.480221:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.480233:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.480256:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.480264:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f07ec766/0xd3c7635991be1a8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.480292:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772517.480294:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772517.480296:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772517.482867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.483011:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796566784 00000100:00100000:3.0:1790772517.483021:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796566784 00000100:00100000:3.0:1790772517.483086:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:3.0:1790772517.483095:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796566784:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790772517.539667:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1790772517.539688:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1790772517.540421:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796566784:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 57320us (57558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.540434:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1790772517.549561:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.549718:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796567040 00000100:00100000:1.0:1790772517.549729:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796567040 00000100:00100000:1.0:1790772517.549783:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:1.0:1790772517.549794:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10429:x1877760796567040:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.549849:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772517.549897:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be1a75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5093c expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.550066:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:1.0:1790772517.550072:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772517.550106:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.550120:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.550130:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772517.550385:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b116b33c reply state 000000001cdaf141 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.550407:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772517.550602:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10429:x1877760796567040:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 808us (1049us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1790772517.550610:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00010000:00010000:2.0:1790772517.554083:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.554105:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.554112:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.554117:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772517.554121:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.554130:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.554144:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:2.0:1790772517.554146:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772517.554150:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.554155:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1a91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.555568:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.556104:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796567168 00000100:00100000:2.0:1790772517.556115:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796567168 00000100:00100000:2.0:1790772517.556170:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1790772517.556180:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796567168:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790772517.556433:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790772517.556437:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790772517 -> 1790772516 00002000:00010000:2.0:1790772517.556440:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790772514 00002000:00010000:2.0:1790772517.556442:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790772517 -> 1790772516 00002000:00010000:2.0:1790772517.556452:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790772517.556584:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2357:x1877760796567168:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 405us (1023us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790772517.556592:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1790772517.560381:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.560614:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796567424 00000100:00100000:1.0:1790772517.560625:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796567424 00000100:00100000:1.0:1790772517.560687:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1790772517.560697:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10429:x1877760796567424:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.560764:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.560781:0:8380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.560792:0:8380:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.560828:0:8380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.560845:0:8380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 13 pid: 5855 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.560859:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813369088:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772517.561054:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a16530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772517.567814:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.567817:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813369088:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772517.567845:0:8380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.569231:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796567552 00000100:00100000:3.0:1790772517.569243:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796567552 00010000:00010000:3.0:1790772517.569283:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 14 pid: 5855 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.569333:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1790772517.569343:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2354:x1877760796567552:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772517.569358:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772517.569364:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 14 pid: 5855 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.569376:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 14 pid: 5855 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.569393:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5092e expref: 14 pid: 5855 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.569404:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:3.0:1790772517.569407:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.569415:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.569426:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.569446:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772517.569468:0:8380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.569475:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.569500:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2354:x1877760796567552:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 158us (1694us total) trans 0 rc 0/0 00010000:00010000:1.0:1790772517.569504:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.569507:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00010000:00010000:1.0:1790772517.569511:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.569595:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.569603:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.569607:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.569614:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.569622:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:1.0:1790772517.569625:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790772517.569628:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.569634:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1a98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.569679:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:10429:x1877760796567424:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 8984us (9308us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790772517.569688:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1790772517.580185:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.580254:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796567680 00000100:00100000:3.0:1790772517.580264:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796567680 00000100:00100000:3.0:1790772517.580326:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:3.0:1790772517.580335:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796567680:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790772517.580376:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.580395:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.580404:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772517.580408:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772517.580412:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.580444:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.580458:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 7 pid: 6706 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.580479:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813369216:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772517.580559:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328812ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772517.589767:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813369216:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772517.589808:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772517.591742:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.591838:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796567808 00000100:00100000:3.0:1790772517.591847:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796567808 00010000:00010000:3.0:1790772517.591920:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.591969:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1790772517.591979:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796567808:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772517.591994:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772517.592016:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592029:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592051:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e7fc067/0xd3c7635991be1a83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5094a expref: 8 pid: 6706 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592066:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772517.592077:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772517.592083:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592093:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592121:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772517.592167:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796567808:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 190us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.592174:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00010000:00010000:3.0:1790772517.592200:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592208:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592235:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592243:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592251:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592258:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772517.592269:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592279:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592290:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.592297:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018f1380/0xd3c7635991be1a9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.592343:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796567680:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 12009us (12169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.592351:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1790772517.598047:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.598205:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796568064 00000100:00100000:1.0:1790772517.598216:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796568064 00000100:00100000:1.0:1790772517.598273:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:1.0:1790772517.598282:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:10429:x1877760796568064:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790772517.598379:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598398:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598409:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598657:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598668:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 13 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598676:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598709:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 13 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.598724:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 13 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.598746:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813369344:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772517.598825:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a16530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772517.609813:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813369344:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772517.609844:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772517.620786:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.620899:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796568192 00000100:00100000:3.0:1790772517.620911:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796568192 00010000:00010000:3.0:1790772517.620963:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 14 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.620999:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1790772517.621010:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2355:x1877760796568192:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772517.621026:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772517.621033:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 14 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.621046:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 14 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.621078:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1a60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50935 expref: 14 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.621093:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:3.0:1790772517.621099:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.621109:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.621117:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.621150:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772517.621204:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2355:x1877760796568192:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 197us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.621211:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00010000:00010000:1.0:1790772517.621294:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.621302:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772517.621474:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1790772517.624453:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1790772517.624544:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1790772517.625098:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5856:1877760813369472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790772517.625168:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772517.625210:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a2183900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772517.627997:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813369472 00000100:00100000:3.0:1790772517.628013:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813369472 00000100:00100000:3.0:1790772517.628068:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772517.628078:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1877760813369472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790772517.628209:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1877760813369472:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (3039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.628217:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772517.628418:0:5856:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1790772517.628425:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328c0e6c000, transno 4294967303 00000100:00100000:0.0:1790772517.628448:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5856:1877760813369472:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790772517.629410:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1790772517.629500:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5856:1877760813369600:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790772517.629555:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772517.629588:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836dfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772517.629619:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813369600 00000100:00100000:0.0:1790772517.629624:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813369600 00000100:00100000:0.0:1790772517.629654:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772517.629660:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1877760813369600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790772517.629859:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1877760813369600:12345-0@lo:1000:mdt00_001.0 Request processed in 197us (302us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790772517.629866:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772517.629952:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5856:1877760813369600:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790772517.630510:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630524:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630532:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630539:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772517.630543:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630552:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630583:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:0.0:1790772517.630586:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772517.630592:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630599:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1aad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630642:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630650:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630655:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630660:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772517.630662:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630668:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630676:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:0.0:1790772517.630678:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772517.630681:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630686:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be19db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630717:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630731:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630740:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630774:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.630790:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 16 pid: 5856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772517.630802:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813369728:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772517.630971:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836dfe40 going to sleep for 11 seconds 00010000:00010000:3.0:1790772517.644044:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772517.650359:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813369728:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772517.650395:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772517.652262:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772517.652704:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796568320 00000100:00100000:3.0:1790772517.652715:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796568320 00010000:00010000:3.0:1790772517.652755:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 17 pid: 5856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772517.652807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1790772517.652821:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:2355:x1877760796568320:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772517.652834:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772517.652841:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 17 pid: 5856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.652853:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 17 pid: 5856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.652910:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be19f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50919 expref: 17 pid: 5856 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.652945:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:3.0:1790772517.652951:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.652962:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.652969:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772517.653205:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772517.653272:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:2355:x1877760796568320:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 454us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772517.653279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00010000:00010000:1.0:1790772517.653343:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653352:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653366:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653374:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653389:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653395:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.653400:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653407:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653417:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:1.0:1790772517.653420:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772517.653423:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653429:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1ab4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653440:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653446:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653452:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653458:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.653460:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653475:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653484:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803200) 00010000:00010000:1.0:1790772517.653486:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772517.653489:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.653493:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1aa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.653722:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10429:x1877760796568064:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 55440us (55684us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1790772517.653731:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000020:00080000:1.0:1790772517.653735:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790772517.654118:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772517.654123:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772517.654160:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790772517.654166:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772517.662803:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.662845:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796568576 00000100:00100000:1.0:1790772517.662856:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796568576 00000100:00100000:1.0:1790772517.662953:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1790772517.662964:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10429:x1877760796568576:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790772517.663620:0:5859:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790772517.663725:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1790772517.663780:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.663799:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.663811:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.663828:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.663835:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.663841:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.663869:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772517.664207:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772517.664215:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.664221:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772517.664226:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.664235:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.664250:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9328a16c3300) 00010000:00010000:2.0:1790772517.664253:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790772517.664257:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.664263:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1abb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.664283:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772517.664285:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772517.664287:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772517.667857:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:10429:x1877760796568576:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 4885us (5052us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1790772517.667898:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000020:00080000:0.0:1790772517.667906:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1790772517.705760:0:12015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772517.705771:0:12015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772517.705826:0:12015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790772517.705840:0:12015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772517.868215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.868418:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796568832 00000100:00100000:1.0:1790772517.868429:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796568832 00000100:00100000:1.0:1790772517.868491:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:1.0:1790772517.868502:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:10439:x1877760796568832:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772517.868527:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772517.868548:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50951 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.868650:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1ac9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.868667:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.868679:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772517.868690:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790772517.868809:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50951 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.868841:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50951 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.868850:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772517.868852:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772517.868855:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db600, rc 0) 00000100:00100000:1.0:1790772517.868964:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:10439:x1877760796568832:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 464us (759us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790772517.868971:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:2.0:1790772517.871554:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.871624:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796568960 00000100:00100000:1.0:1790772517.871634:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796568960 00000100:00100000:1.0:1790772517.871690:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:1.0:1790772517.871701:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:10439:x1877760796568960:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:1.0:1790772517.871777:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.871794:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.871805:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.871821:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.871834:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.871854:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872139:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872148:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872156:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772517.872197:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872210:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872217:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872224:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872231:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.872236:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872243:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872254:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772517.872262:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772517.872268:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872273:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872285:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872290:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872295:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872300:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.872302:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872308:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872315:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a16c3c00) 00010000:00010000:1.0:1790772517.872317:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772517.872319:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872323:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872335:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872346:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872351:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872356:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.872358:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872364:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872372:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:1.0:1790772517.872373:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772517.872375:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.872380:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.872467:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:10439:x1877760796568960:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 768us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772517.872476:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:3.0:1790772517.980507:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772517.980643:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796569216 00000100:00100000:2.0:1790772517.980655:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796569216 00000100:00100000:2.0:1790772517.980752:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:2.0:1790772517.980763:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:10442:x1877760796569216:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772517.980789:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772517.980814:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50958 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.980960:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.980976:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.980988:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.981006:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.981013:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.981020:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982064:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982093:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982103:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772517.982115:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790772517.982225:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982234:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982241:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982247:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772517.982251:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982258:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982270:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772517.982273:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772517.982277:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982283:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982540:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982554:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982560:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982564:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772517.982567:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982573:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982581:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a1803700) 00010000:00010000:2.0:1790772517.982585:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772517.982588:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772517.982595:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.982726:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.982746:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772517.982765:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:0.0:1790772517.982767:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772517.982770:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519800, rc 0) 00000100:00100000:0.0:1790772517.982922:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10442:x1877760796569216:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2151us (2419us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790772517.982940:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1790772517.987414:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772517.987510:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796569344 00000100:00100000:1.0:1790772517.987522:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796569344 00000100:00100000:1.0:1790772517.987609:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:1.0:1790772517.987620:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10442:x1877760796569344:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1790772517.987689:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987721:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987735:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987762:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987769:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987775:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987781:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772517.987784:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987792:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987802:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:1.0:1790772517.987805:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772517.987811:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772517.987817:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772517.987927:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10442:x1877760796569344:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 308us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772517.987950:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:3.0:1790772517.993409:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772517.993613:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796569600 00000100:00100000:0.0:1790772517.993625:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796569600 00000100:00100000:0.0:1790772517.993714:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1790772517.993724:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10442:x1877760796569600:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772517.994160:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:10442:x1877760796569600:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 435us (761us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790772517.994169:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1790772518.032360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.032454:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796569856 00000100:00100000:1.0:1790772518.032464:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796569856 00000100:00100000:1.0:1790772518.032532:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:1.0:1790772518.032543:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:9970:x1877760796569856:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772518.032580:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772518.032607:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5095f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.032717:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.032733:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 23 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.032743:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.032780:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 23 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.032803:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 23 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.032816:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813369856:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772518.032968:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289f12bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772518.040536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.040629:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813369856:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772518.040667:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.040743:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796569984 00000100:00100000:3.0:1790772518.040751:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796569984 00010000:00010000:3.0:1790772518.040786:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 24 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.040823:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1790772518.040832:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:2355:x1877760796569984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772518.040847:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772518.040853:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 24 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.040865:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 24 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.040936:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50958 expref: 24 pid: 8380 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.040952:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:3.0:1790772518.040962:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.040980:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.040988:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.041011:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772518.041068:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:2355:x1877760796569984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 236us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772518.041075:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00010000:00010000:1.0:1790772518.041593:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.041603:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772518.041624:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790772518.041784:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1b16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.041800:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.041809:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:1.0:1790772518.041812:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772518.041814:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772518.041855:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:9970:x1877760796569856:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9315us (9507us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1790772518.041863:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1790772518.046789:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.047588:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796570240 00000100:00100000:1.0:1790772518.047601:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796570240 00000100:00100000:0.0:1790772518.047751:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:0.0:1790772518.047761:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:9970:x1877760796570240:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1790772518.048317:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.048333:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.048344:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772518.048399:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1790772518.048442:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000058b08894 reply state 000000003162dba1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.048451:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790772518.048501:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1790772518.048616:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:9970:x1877760796570240:12345-192.168.201.34@tcp:36:bash.0 Request processed in 855us (1838us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1790772518.048623:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000020:00080000:0.0:1790772518.048629:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790772518.051187:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.051205:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.051212:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.051218:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.051224:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.051231:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.051247:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:0.0:1790772518.051251:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.051256:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.051263:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.053448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.053525:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796570368 00000100:00100000:0.0:1790772518.053537:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796570368 00000100:00100000:0.0:1790772518.053599:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:0.0:1790772518.053610:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:9970:x1877760796570368:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772518.053638:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772518.053661:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1b32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50966 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.053725:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50966 expref: 27 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.053741:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50966 expref: 27 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.053762:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:0.0:1790772518.053766:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772518.053769:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93e00, rc 0) 00000100:00100000:0.0:1790772518.053840:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:9970:x1877760796570368:12345-192.168.201.34@tcp:101:bash.0 Request processed in 231us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.053848:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1790772518.057962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.058156:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796570496 00000100:00100000:2.0:1790772518.058167:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796570496 00000100:00100000:2.0:1790772518.058229:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1790772518.058239:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:9970:x1877760796570496:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772518.058257:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772518.058280:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5096d expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772518.058334:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd0524, atime: 0x6abd0522, ctime: 0x6abd0524, blocks: 0xb 00010000:00010000:2.0:1790772518.058356:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1790772518.058362:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772518.058371:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.058387:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.058399:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519600, rc 0) 00000100:00100000:2.0:1790772518.058462:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:9970:x1877760796570496:12345-192.168.201.34@tcp:101:bash.0 Request processed in 224us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772518.058469:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1790772518.061693:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.061788:0:6709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796570624 00000100:00100000:0.0:1790772518.061798:0:6709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796570624 00002000:00010000:0.0:1790772518.061835:0:6709:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1790772518.061840:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c0e6d500 with x1877760796570624 ext(0->18446744073709551615) 00002000:00010000:0.0:1790772518.061851:0:6709:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c0e6d500. 00000100:00100000:0.0:1790772518.061906:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1790772518.061940:0:6709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796570624:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:0.0:1790772518.062226:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790772518.062230:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790772516 -> 1790772518 00002000:00010000:0.0:1790772518.062233:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790772514 -> 1790772514 00002000:00010000:0.0:1790772518.062235:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790772516 -> 1790772518 00002000:00010000:0.0:1790772518.062238:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790772518.062423:0:6709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796570624:12345-192.168.201.34@tcp:10:bash.0 Request processed in 365us (609us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790772518.062432:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00010000:0.0:1790772518.062437:0:6709:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1790772518.062440:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c0e6d500 with x1877760796570624 ext(0->18446744073709551615) 00002000:00010000:0.0:1790772518.062446:0:6709:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c0e6d500. 00000100:00100000:0.0:1790772518.156933:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.157162:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796570752 00000100:00100000:2.0:1790772518.157173:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796570752 00000100:00100000:2.0:1790772518.157233:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:2.0:1790772518.157243:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:10456:x1877760796570752:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1790772518.157321:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157338:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157349:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157385:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157393:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157399:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157621:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157630:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157636:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772518.157675:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157686:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157692:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157699:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157705:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.157709:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157723:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157733:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772518.157736:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.157741:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157747:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157759:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157765:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157770:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157775:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.157778:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157783:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157791:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a1803500) 00010000:00010000:2.0:1790772518.157793:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.157796:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157812:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157828:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157834:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157840:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157844:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.157848:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157854:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157862:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:2.0:1790772518.157864:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.157867:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.157943:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772518.158026:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:10456:x1877760796570752:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 782us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772518.158035:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:1.0:1790772518.205072:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.205227:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796571008 00000100:00100000:0.0:1790772518.205239:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796571008 00000100:00100000:0.0:1790772518.205315:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1790772518.205325:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:10459:x1877760796571008:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772518.205345:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772518.205367:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50974 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205439:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205453:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205484:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205501:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205507:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205514:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205775:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205784:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.205791:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772518.205801:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790772518.206225:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206235:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206243:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206249:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.206262:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206270:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206283:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772518.206345:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.206353:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206360:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1b5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206374:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206380:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206386:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206391:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.206394:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206399:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206408:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8f00) 00010000:00010000:0.0:1790772518.206410:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.206419:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206426:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1b63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206471:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50974 expref: 30 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206486:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50974 expref: 29 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.206493:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:0.0:1790772518.206495:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772518.206498:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92600, rc 0) 00000100:00100000:0.0:1790772518.206614:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10459:x1877760796571008:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1289us (1552us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1790772518.206623:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1790772518.212217:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.212369:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796571136 00000100:00100000:0.0:1790772518.212380:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796571136 00000100:00100000:0.0:1790772518.212504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:0.0:1790772518.212517:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10459:x1877760796571136:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1790772518.212598:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.212617:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.212626:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.212676:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.212690:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 29 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.212705:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813369984:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772518.212802:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772518.216721:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.216942:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796571392 00000100:00100000:2.0:1790772518.216952:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796571392 00000100:00100000:2.0:1790772518.217024:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1790772518.217035:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:5594:x1877760796571392:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790772518.217382:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:5594:x1877760796571392:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 346us (671us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1790772518.217390:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772518.218035:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813369984:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772518.218060:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.220271:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772518.220424:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796571520 00000100:00100000:3.0:1790772518.220435:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796571520 00010000:00010000:3.0:1790772518.220477:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 31 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.220521:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1790772518.220530:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:2354:x1877760796571520:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772518.220544:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772518.220551:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 31 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.220564:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 31 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.220608:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1b1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5095f expref: 31 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.220625:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:3.0:1790772518.220630:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.220640:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.220646:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.220679:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772518.220737:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:2354:x1877760796571520:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 207us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772518.220744:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00010000:00010000:0.0:1790772518.220820:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220828:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220857:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220864:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220871:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220915:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.220919:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220944:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220954:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:0.0:1790772518.220956:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772518.220961:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.220968:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.221024:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10459:x1877760796571136:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 8510us (8820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.221032:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1790772518.224187:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.224411:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796571776 00000100:00100000:2.0:1790772518.224423:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796571776 00000100:00100000:2.0:1790772518.224476:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1790772518.224486:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:10459:x1877760796571776:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1790772518.224747:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:10459:x1877760796571776:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 261us (568us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1790772518.224755:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1790772518.319632:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.319864:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796572032 00000100:00100000:2.0:1790772518.320083:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796572032 00000100:00100000:2.0:1790772518.320191:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:2.0:1790772518.320201:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:10470:x1877760796572032:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1790772518.320231:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772518.320252:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5097b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320330:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320345:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320376:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320392:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320399:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320405:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320674:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320683:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320690:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772518.320700:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790772518.320804:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320812:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320819:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320824:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.320835:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320842:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320854:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772518.320858:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.320862:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320868:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1b86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320905:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320930:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320937:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320942:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.320946:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320952:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320960:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a1803500) 00010000:00010000:2.0:1790772518.320962:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.320982:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.320988:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.321037:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5097b expref: 33 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.321050:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5097b expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.321057:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:2.0:1790772518.321059:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772518.321061:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519200, rc 0) 00000100:00100000:2.0:1790772518.321137:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:10470:x1877760796572032:12345-192.168.201.34@tcp:101:cat.0 Request processed in 937us (1516us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790772518.321145:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:1.0:1790772518.326840:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.327091:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796572288 00000100:00100000:2.0:1790772518.327103:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796572288 00000100:00100000:2.0:1790772518.327169:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1790772518.327179:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:10470:x1877760796572288:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:2.0:1790772518.327428:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:10470:x1877760796572288:12345-192.168.201.34@tcp:35:cat.0 Request processed in 249us (599us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1790772518.327435:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1790772518.355869:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.355995:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796572544 00000100:00100000:2.0:1790772518.356006:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796572544 00000100:00100000:2.0:1790772518.356068:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1790772518.356079:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:10471:x1877760796572544:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1790772518.356156:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790772518.356182:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5097b expref: 33 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356202:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50974 expref: 32 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356215:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50966 expref: 31 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356226:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803900) 00010000:00010000:2.0:1790772518.356235:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772518.356253:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356266:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356276:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356288:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356304:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356311:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356708:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356717:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.356725:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772518.358268:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1790772518.358283:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339178407040ns, next at 340178403739ns, rc = 0 00010000:00010000:2.0:1790772518.358494:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358584:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358596:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358603:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358610:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358617:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358679:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772518.358704:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358721:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358728:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358733:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.358738:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358746:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358757:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803300) 00010000:00010000:2.0:1790772518.358760:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790772518.358777:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358783:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1bb0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358805:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358811:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358816:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358820:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.358829:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358835:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358843:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772518.358846:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.358848:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.358854:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1ba2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772518.358864:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bbe921ba reply state 0000000099825d74 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772518.358893:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772518.359026:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:10471:x1877760796572544:12345-192.168.201.34@tcp:36:rm.0 Request processed in 2944us (3161us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790772518.359035:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00010000:00010000:0.0:1790772518.363409:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772518.363424:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.363435:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772518.363440:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.363449:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.363468:0:8521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9328a1803300) 00010000:00010000:0.0:1790772518.363471:0:8521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790772518.363475:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.363839:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1bb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.363870:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772518.364163:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772518.364166:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772518.366104:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.366122:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.366128:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.366134:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.366138:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.366160:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.366176:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a1803500) 00010000:00010000:2.0:1790772518.366179:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.366184:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.366191:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1ba9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.445729:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.446184:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796572800 00000100:00100000:0.0:1790772518.446196:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796572800 00000100:00100000:0.0:1790772518.446288:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:0.0:1790772518.446308:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:10477:x1877760796572800:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772518.446336:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772518.446359:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1bbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50982 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.446486:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.446498:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.446506:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.446515:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.446519:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.446523:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772518.447092:0:8380:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790772518.447266:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447277:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447286:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447323:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447330:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447337:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447342:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.447346:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447353:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447364:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772518.447367:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.447372:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447391:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772518.447403:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000afcfc788 reply state 000000002d8333de transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.447411:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772518.447439:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1bbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 34 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447453:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 33 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.447459:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772518.447461:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772518.447463:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:0.0:1790772518.447534:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:10477:x1877760796572800:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1228us (1814us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790772518.447542:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00010000:00010000:0.0:1790772518.450216:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.450235:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.450243:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.450248:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.450266:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.450274:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.450290:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8f00) 00010000:00010000:0.0:1790772518.450304:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.450310:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.450317:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1bcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.455129:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772518.455404:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796572928 00000100:00100000:3.0:1790772518.455415:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796572928 00000100:00100000:3.0:1790772518.455493:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1790772518.455504:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796572928:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1790772518.455523:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772518.455548:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50989 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772518.455580:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772518.455603:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1790772518.455621:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772518.455631:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.455652:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.455665:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8200, rc 0) 00000100:00100000:3.0:1790772518.455726:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796572928:12345-192.168.201.34@tcp:101:bash.0 Request processed in 225us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772518.455733:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00080000:1.0:1790772518.455935:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772518.460069:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.460225:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796573056 00000100:00100000:2.0:1790772518.460236:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796573056 00000100:00100000:2.0:1790772518.460312:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1790772518.460322:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:10477:x1877760796573056:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772518.460345:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772518.460364:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50990 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.460400:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.460408:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772518.460412:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772518.460417:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.460449:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.460478:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772518.460493:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1877760813370112:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772518.460583:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772518.464700:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1877760813370112:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772518.464741:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.464762:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519c00, rc 0) 00000100:00100000:2.0:1790772518.464824:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:10477:x1877760796573056:12345-192.168.201.34@tcp:101:bash.0 Request processed in 4503us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772518.464834:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1790772518.465140:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.465774:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796573184 00000100:00100000:0.0:1790772518.465784:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796573184 00010000:00010000:0.0:1790772518.465823:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.465864:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1790772518.465929:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796573184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772518.465947:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772518.465982:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.465996:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.466021:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef93992/0xd3c7635991be1be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50989 expref: 9 pid: 6704 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.466055:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772518.466059:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772518.466067:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.466076:0:8465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.466113:0:8465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.466127:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8465:1877760813370240:192.168.201.34@tcp:105: 00000100:00100000:0.0:1790772518.466196:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772518.469988:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8465:1877760813370240:192.168.201.34@tcp:105: 00010000:00010000:0.0:1790772518.470020:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772518.470141:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796573184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4268us (5000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.470153:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1790772518.473442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.473622:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796573440 00000100:00100000:2.0:1790772518.473633:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796573440 00000100:00100000:2.0:1790772518.473695:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1790772518.473704:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:10477:x1877760796573440:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1790772518.474094:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:10477:x1877760796573440:12345-192.168.201.34@tcp:35:bash.0 Request processed in 390us (660us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790772518.474102:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1790772518.603365:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813370624:0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.603442:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772518.603510:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772518.603517:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813370496:0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.603540:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772518.603556:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813371008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.603582:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772518.603620:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813371008 00000100:00100000:1.0:1790772518.603628:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813371008 00000100:00100000:1.0:1790772518.603673:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772518.603682:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813371008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.603739:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813371008:12345-0@lo:400:kworker.0 Request processed in 57us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772518.603747:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772518.603793:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813371008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.603819:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813370624 00000100:00100000:1.0:1790772518.603823:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813370624 00000100:00100000:1.0:1790772518.603854:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813370496 00000100:00100000:1.0:1790772518.603858:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813370496 00000100:00100000:1.0:1790772518.603931:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790772518.603939:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813370624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.603991:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813370624:12345-0@lo:400:kworker.0 Request processed in 53us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772518.603997:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790772518.604010:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790772518.604016:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813370496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.604045:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813370496:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772518.604051:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1790772518.604069:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772518.604089:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813370496:0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.604099:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813370624:0@lo:400:kworker.0 00000100:00100000:0.0:1790772518.604481:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813370752:0@lo:400:kworker.0 00000100:00100000:0.0:1790772518.604517:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772518.604557:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790772518.604564:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813370368:0@lo:400:kworker.0 00000100:00100000:0.0:1790772518.604593:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772518.604633:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813370880:0@lo:400:kworker.0 00000100:00100000:0.0:1790772518.604657:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772518.604682:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813370880 00000100:00100000:0.0:1790772518.604687:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813370880 00000100:00100000:0.0:1790772518.604717:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790772518.604723:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813370880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772518.604762:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813370880:12345-0@lo:400:kworker.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.604768:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790772518.604795:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813370880:0@lo:400:kworker.0 00000100:00100000:3.0:1790772518.604870:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813370368 00000100:00100000:3.0:1790772518.604895:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813370368 00000100:00100000:3.0:1790772518.604942:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1790772518.604950:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813370368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772518.605065:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813370368:12345-0@lo:400:kworker.0 Request processed in 116us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772518.605072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1790772518.605109:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813370368:0@lo:400:kworker.0 00000100:00080000:1.0:1790772518.605184:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772518.605196:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813370752 00000100:00100000:1.0:1790772518.605200:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813370752 00000100:00100000:1.0:1790772518.605235:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790772518.605242:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1877760813370752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.605282:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1877760813370752:12345-0@lo:400:kworker.0 Request processed in 40us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772518.605288:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790772518.605371:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813370752:0@lo:400:kworker.0 00000100:00100000:1.0:1790772518.643284:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.643407:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796573568 00000100:00100000:0.0:1790772518.643418:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796573568 00000100:00100000:0.0:1790772518.643478:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:0.0:1790772518.643487:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:10493:x1877760796573568:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772518.643512:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772518.643537:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50997 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.643605:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1bf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.643621:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.643632:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772518.643664:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790772518.643681:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772518.643704:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.643729:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50997 expref: 36 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.643749:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50997 expref: 35 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.643757:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772518.643761:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772518.643764:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93800, rc 0) 00000100:00100000:0.0:1790772518.643835:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:10493:x1877760796573568:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 349us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.643843:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:0.0:1790772518.647955:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.648219:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796573824 00000100:00100000:1.0:1790772518.648229:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796573824 00000100:00100000:1.0:1790772518.648322:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:1.0:1790772518.648333:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:10493:x1877760796573824:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772518.648369:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772518.648389:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a5099e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.648487:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.648502:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.648513:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772518.648524:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790772518.648656:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5099e expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.648674:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5099e expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.648683:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:1.0:1790772518.648685:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772518.648689:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db800, rc 0) 00000100:00100000:1.0:1790772518.648825:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:10493:x1877760796573824:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 425us (815us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790772518.648835:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:3.0:1790772518.652574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772518.652669:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.652742:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574208 00000100:00100000:1.0:1790772518.652753:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574208 00000100:00100000:1.0:1790772518.652825:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1790772518.652849:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:2356:x1877760796574208:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772518.652869:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772518.652929:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5099e expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.652950:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:1.0:1790772518.652954:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772518.653013:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:2356:x1877760796574208:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 166us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772518.653020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1790772518.653774:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574080 00000100:00100000:0.0:1790772518.653781:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574080 00000100:00100000:0.0:1790772518.653818:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:0.0:1790772518.653826:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:10493:x1877760796574080:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772518.653849:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772518.653864:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1c12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509a5 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.653977:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.653992:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.654012:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772518.654037:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790772518.654158:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509a5 expref: 39 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.654174:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509a5 expref: 38 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.654182:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:0.0:1790772518.654184:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790772518.654187:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92200, rc 0) 00000100:00100000:0.0:1790772518.654229:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:10493:x1877760796574080:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 405us (1667us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790772518.654236:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:3.0:1790772518.661181:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.661228:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574336 00000100:00100000:0.0:1790772518.661239:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574336 00000100:00100000:0.0:1790772518.661343:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1790772518.661353:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796574336:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1790772518.661399:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.661421:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.661430:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772518.661449:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772518.661455:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.661492:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.661520:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 8 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.661536:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf56ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813371136:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772518.661620:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790772518.668605:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772518.671731:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf56ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813371136:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772518.671772:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772518.672434:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.675967:0:6711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574464 00000100:00100000:1.0:1790772518.675983:0:6711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574464 00002000:00100000:1.0:1790772518.676155:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9328bfd8bb80 x1877760796574464/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:109/0 lens 504/0 e 0 to 0 dl 1790772529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772518.676167:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328bfd8bb80 with x1877760796574464 ext(0->8) 00010000:00010000:1.0:1790772518.676177:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 9 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.676195:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 9 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772518.676204:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9328bfd8bb80 00000100:00100000:1.0:1790772518.676245:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1790772518.676254:0:6711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2354:x1877760796574464:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:1.0:1790772518.678316:0:6711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2354:x1877760796574464:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 2053us (5873us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790772518.678343:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00100000:1.0:1790772518.678357:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9328bfd8bb80 x1877760796574464/t4294967302(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:109/0 lens 504/448 e 0 to 0 dl 1790772529 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772518.678367:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328bfd8bb80 with x1877760796574464 ext(0->8) 00010000:00010000:1.0:1790772518.678377:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 11 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.678396:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 11 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772518.678405:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9328bfd8bb80 00000100:00100000:3.0:1790772518.684809:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.684943:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574592 00000100:00100000:0.0:1790772518.684953:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574592 00010000:00010000:0.0:1790772518.685003:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 11 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.685045:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1790772518.685055:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2355:x1877760796574592:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772518.685071:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790772518.685091:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790772518.685094:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790772518 00002000:00010000:0.0:1790772518.685107:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790772519 00002000:00010000:0.0:1790772518.685108:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790772518 00010000:00010000:0.0:1790772518.685116:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 11 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.685129:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 11 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.685152:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085c2d3f1/0xd3c7635991be1be8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50990 expref: 11 pid: 6706 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.685169:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772518.685173:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772518.685179:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.685188:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.685227:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772518.685290:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2355:x1877760796574592:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 236us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.685298:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00010000:00010000:1.0:1790772518.685382:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685391:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685414:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685422:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685430:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685450:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772518.685455:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685464:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685476:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.685484:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c26187/0xd3c7635991be1c27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.685530:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796574336:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 24179us (24358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772518.685538:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1790772518.693359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.693441:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574848 00000100:00100000:2.0:1790772518.693451:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574848 00000100:00100000:2.0:1790772518.693525:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1790772518.693535:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:10493:x1877760796574848:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:2.0:1790772518.693617:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509a5 expref: 38 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772518.693848:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1790772518.694062:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1790772518.694376:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1790772518.694422:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.694434:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 42 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.694441:0:5859:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.694467:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 42 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.694478:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 42 pid: 8380 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772518.694488:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5859:1877760813371264:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772518.694674:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772518.701652:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.701829:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5859:1877760813371264:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772518.701858:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.702154:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796574976 00000100:00100000:3.0:1790772518.702164:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796574976 00010000:00010000:3.0:1790772518.702202:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 43 pid: 8380 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.702245:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1790772518.702256:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+43:2355:x1877760796574976:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772518.702271:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772518.702278:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 43 pid: 8380 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.702290:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 43 pid: 8380 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.702311:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50982 expref: 43 pid: 8380 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.702326:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772518.702331:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.702341:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.702348:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.702380:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772518.702441:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.702449:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:2355:x1877760796574976:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 195us (806us total) trans 0 rc 0/0 00010000:00010000:1.0:1790772518.702449:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.702457:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000001:00080000:1.0:1790772518.702585:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1790772518.702779:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1790772518.704645:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f363800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5859:1877760813371392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790772518.705168:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772518.705251:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff932885678a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772518.705372:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813371392 00000100:00100000:0.0:1790772518.705380:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813371392 00000100:00100000:0.0:1790772518.705471:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772518.705481:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5859:x1877760813371392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790772518.705646:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5859:x1877760813371392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.705653:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772518.705775:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f363800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5859:1877760813371392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790772518.706708:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1790772518.706799:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5859:1877760813371520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790772518.706853:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772518.707127:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328869f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772518.707432:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813371520 00000100:00100000:0.0:1790772518.707439:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813371520 00000100:00100000:0.0:1790772518.707474:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772518.707482:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5859:x1877760813371520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790772518.707693:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5859:x1877760813371520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 211us (839us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790772518.707701:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790772518.707795:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5859:1877760813371520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790772518.707856:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1790772518.708227:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.708238:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.708246:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.708252:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772518.708258:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.708267:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.708373:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772518.708376:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790772518.708382:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772518.708398:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790772518.708582:0:5859:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790772518.708734:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1790772518.708747:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339528871248ns, next at 340528868808ns, rc = 0 00000001:00080000:3.0:1790772518.708755:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1790772518.708793:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8200) 00010000:00010000:3.0:1790772518.708797:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790772518.708803:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509a5 expref: 46 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772518.709384:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10493:x1877760796574848:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 15849us (16033us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1790772518.709394:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000020:00080000:3.0:1790772518.709400:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790772518.713135:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.713234:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796575104 00000100:00100000:0.0:1790772518.713244:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796575104 00000100:00100000:0.0:1790772518.713304:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:0.0:1790772518.713311:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:10493:x1877760796575104:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772518.713335:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772518.713356:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509ac expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.713412:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ac expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.713421:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ac expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.713436:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772518.713438:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772518.713446:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92400, rc 0) 00000100:00100000:0.0:1790772518.713502:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10493:x1877760796575104:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 191us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.713507:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:0.0:1790772518.719167:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772518.719370:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796575360 00000100:00100000:3.0:1790772518.719380:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796575360 00000100:00100000:3.0:1790772518.719443:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1790772518.719451:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:10493:x1877760796575360:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772518.719682:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10493:x1877760796575360:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 229us (524us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1790772518.719690:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1790772518.827237:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.827375:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796575488 00000100:00100000:0.0:1790772518.827388:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796575488 00000100:00100000:0.0:1790772518.827451:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1790772518.827462:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10503:x1877760796575488:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1790772518.827549:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827569:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827580:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827596:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827603:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827608:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827713:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827722:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827744:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772518.827790:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827803:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827810:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827817:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827823:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.827827:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.827835:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828224:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772518.828227:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.828232:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828237:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828253:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828268:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828274:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828278:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.828443:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828450:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828459:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8700) 00010000:00010000:0.0:1790772518.828462:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.828465:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828471:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828488:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828498:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828503:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828508:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772518.828518:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828524:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828532:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772518.828534:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772518.828537:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.828542:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.828802:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10503:x1877760796575488:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1338us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.828811:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1790772518.885786:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.886110:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796575744 00000100:00100000:2.0:1790772518.886121:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796575744 00000100:00100000:2.0:1790772518.886220:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:2.0:1790772518.886228:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:10506:x1877760796575744:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772518.886246:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772518.886265:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509b3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886333:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886345:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886353:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886363:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886367:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886371:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886463:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886468:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886488:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772518.886497:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790772518.886593:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886599:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886603:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886607:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.886610:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886615:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886623:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772518.886624:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.886628:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886631:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886641:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886645:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886655:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886658:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.886660:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886663:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886667:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328a1803500) 00010000:00010000:2.0:1790772518.886669:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772518.886670:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886673:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886702:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886710:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.886715:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772518.886716:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772518.886718:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519800, rc 0) 00000100:00100000:2.0:1790772518.886779:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:10506:x1877760796575744:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 552us (1002us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790772518.886795:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:1.0:1790772518.889714:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.889806:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796575872 00000100:00100000:2.0:1790772518.889817:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796575872 00000100:00100000:2.0:1790772518.889948:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:2.0:1790772518.889959:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:10506:x1877760796575872:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1790772518.890053:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890072:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890084:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890113:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890121:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890128:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890134:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772518.890139:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890147:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890158:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772518.890177:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772518.890184:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.890191:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772518.890273:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:10506:x1877760796575872:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 315us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772518.890735:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:3.0:1790772518.898335:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772518.898417:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796576128 00000100:00100000:0.0:1790772518.898425:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796576128 00000100:00100000:0.0:1790772518.898512:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1790772518.898523:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:10506:x1877760796576128:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772518.898761:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:10506:x1877760796576128:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 239us (479us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1790772518.898769:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1790772518.983734:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772518.984268:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796576384 00000100:00100000:1.0:1790772518.984289:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796576384 00000100:00100000:1.0:1790772518.984356:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:1.0:1790772518.984367:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:10516:x1877760796576384:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772518.984393:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772518.984397:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790772518.984421:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1bf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50997 expref: 50 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.984442:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772518.984447:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772518.984461:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509ba expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.984560:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.984575:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.984584:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.984627:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772518.984642:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 50 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772518.984655:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f361f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813371648:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772518.984751:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff932885678e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772518.991445:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772518.991572:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f361f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813371648:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772518.991602:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.991691:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796576512 00000100:00100000:0.0:1790772518.991699:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796576512 00010000:00010000:0.0:1790772518.991735:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 51 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772518.991799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1790772518.991809:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f363100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:2354:x1877760796576512:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772518.991828:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772518.991847:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 51 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.991861:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 51 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.991927:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be1c66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509b3 expref: 51 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.991944:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772518.991949:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.991959:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.991967:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772518.991996:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772518.992179:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.992187:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772518.992205:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790772518.992350:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1c7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 52 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.992366:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772518.992372:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772518.992375:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772518.992378:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db200, rc 0) 00000100:00100000:2.0:1790772518.992433:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:10516:x1877760796576384:12345-192.168.201.34@tcp:101:bash.0 Request processed in 8068us (8708us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790772518.992440:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:0.0:1790772518.992500:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f363100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:2354:x1877760796576512:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 691us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772518.992507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:3.0:1790772519.001857:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.002052:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796576768 00000100:00100000:2.0:1790772519.002064:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796576768 00000100:00100000:2.0:1790772519.002199:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:2.0:1790772519.002220:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:10516:x1877760796576768:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1790772519.002487:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.002506:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.002517:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772519.002569:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1790772519.002594:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000008208c56 reply state 00000000d88f28de transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772519.002604:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772519.002703:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:10516:x1877760796576768:12345-192.168.201.34@tcp:36:bash.0 Request processed in 486us (865us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790772519.002711:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00000020:00080000:2.0:1790772519.002716:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1790772519.005137:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790772519.005657:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.005671:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.005697:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.005703:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772519.005707:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.005715:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.005732:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772519.005736:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772519.005740:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.005746:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1c90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.012226:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.012394:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796576896 00000100:00100000:2.0:1790772519.012405:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796576896 00000100:00100000:2.0:1790772519.012467:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:2.0:1790772519.012479:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10516:x1877760796576896:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772519.012507:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772519.012530:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1c97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509c1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.012616:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.012631:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.012655:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.012689:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.012702:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 53 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772519.012716:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813371776:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772519.012801:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772519.016248:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813371776:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772519.016282:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.018037:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.018121:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577024 00000100:00100000:1.0:1790772519.018130:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577024 00010000:00010000:1.0:1790772519.018165:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 54 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772519.018197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1790772519.018217:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:2355:x1877760796577024:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772519.018232:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772519.018240:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 54 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.018253:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 54 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.018275:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1c82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ba expref: 54 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.018308:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772519.018313:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.018323:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.018331:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.018358:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772519.018381:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.018388:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772519.018419:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:2355:x1877760796577024:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 203us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.018426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000004:00200000:2.0:1790772519.018435:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790772519.018438:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772519.018459:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.018490:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1c97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.018522:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.018529:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772519.018532:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772519.018534:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519200, rc 0) 00000100:00100000:2.0:1790772519.018560:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10516:x1877760796576896:12345-192.168.201.34@tcp:101:bash.0 Request processed in 6084us (6347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772519.018566:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:3.0:1790772519.021839:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.022157:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577280 00000100:00100000:2.0:1790772519.022168:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577280 00000100:00100000:2.0:1790772519.022272:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1790772519.022292:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:10516:x1877760796577280:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1790772519.022539:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:10516:x1877760796577280:12345-192.168.201.34@tcp:35:bash.0 Request processed in 258us (709us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790772519.022546:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:3.0:1790772519.026823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.026945:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577408 00000100:00100000:1.0:1790772519.026955:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577408 00000100:00100000:1.0:1790772519.027030:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 291 00000100:00100000:1.0:1790772519.027041:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796577408:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772519.027115:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796577408:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.027123:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 291 00000100:00100000:3.0:1790772519.041931:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.042131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.044255:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.044336:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577792 00000100:00100000:0.0:1790772519.044363:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577792 00000100:00100000:0.0:1790772519.044438:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:0.0:1790772519.044447:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796577792:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772519.044527:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796577792:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772519.044534:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00080000:3.0:1790772519.044759:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772519.045663:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577664 00000100:00100000:1.0:1790772519.045673:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577664 00000100:00100000:0.0:1790772519.045894:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577536 00000100:00100000:0.0:1790772519.045898:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577536 00000100:00100000:0.0:1790772519.045929:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:0.0:1790772519.045937:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2356:x1877760796577664:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772519.045996:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2356:x1877760796577664:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 59us (4090us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772519.046003:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:0.0:1790772519.046019:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1790772519.046026:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2356:x1877760796577536:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772519.046052:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2356:x1877760796577536:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772519.046059:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00080000:1.0:1790772519.046556:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772519.115290:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813371904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772519.115363:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772519.115502:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813371904 00000100:00100000:3.0:1790772519.115512:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813371904 00000100:00100000:3.0:1790772519.115579:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772519.115589:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813371904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772519.115611:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1790772519.115660:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813371904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.115668:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772519.115722:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813371904:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790772519.115894:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772519.150487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.153094:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796577920 00000100:00100000:1.0:1790772519.153108:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796577920 00000100:00100000:1.0:1790772519.153172:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:1.0:1790772519.153182:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:10523:x1877760796577920:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772519.153208:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772519.153226:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509c8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.153299:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.153314:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.153326:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772519.153360:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790772519.153364:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772519.153383:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.153406:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c8 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.153424:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c8 expref: 54 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.153432:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772519.153435:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772519.153453:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dac00, rc 0) 00000100:00100000:1.0:1790772519.153523:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:10523:x1877760796577920:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 341us (3046us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.153531:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:1.0:1790772519.168568:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.169832:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796578048 00000100:00100000:3.0:1790772519.169845:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796578048 00000100:00100000:3.0:1790772519.169934:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:3.0:1790772519.169944:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:10523:x1877760796578048:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772519.169975:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772519.169997:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509cf expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170086:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170100:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170110:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170124:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170130:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170136:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170383:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170393:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170400:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772519.170435:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790772519.170440:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772519.170457:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170480:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170488:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170495:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170501:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170507:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772519.170511:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170518:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170530:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:3.0:1790772519.170534:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772519.170539:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170544:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170564:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170570:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170582:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170587:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772519.170591:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170597:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170606:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff932884f65200) 00010000:00010000:3.0:1790772519.170609:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772519.170612:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170617:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170650:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170663:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.170670:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772519.170672:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772519.170675:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8a00, rc 0) 00000100:00100000:3.0:1790772519.170747:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10523:x1877760796578048:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 804us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.170764:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:0.0:1790772519.177723:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.177775:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.177870:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796578304 00000100:00100000:2.0:1790772519.177898:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796578304 00000100:00100000:2.0:1790772519.177968:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:2.0:1790772519.177978:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10523:x1877760796578304:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772519.177998:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772519.178027:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1ccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509d6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178124:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178153:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178173:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178181:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178393:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178407:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 56 pid: 5856 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772519.178421:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813372032:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772519.178527:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.178536:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772519.178545:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfd8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813372160:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772519.178568:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772519.178645:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796578432 00000100:00100000:3.0:1790772519.178651:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796578432 00010000:00010000:3.0:1790772519.178673:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 57 pid: 5856 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.178705:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1790772519.178713:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:2354:x1877760796578432:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772519.178722:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772519.178728:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 57 pid: 5856 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.178739:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 57 pid: 5856 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.178757:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772519.178761:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.178767:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.178773:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772519.178798:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:2354:x1877760796578432:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 86us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.178805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00010000:00010000:3.0:1790772519.191638:0:5855:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.34@tcp) returned -22 from blocking AST (req@00000000aa018f23 x1877760813372032) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 56 pid: 5856 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.191677:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509cf expref: 56 pid: 5856 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.191701:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813372032:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772519.191714:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfd8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813372160:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772519.191739:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772519.191744:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.191755:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.191764:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772519.196747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.197616:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796578560 00000100:00100000:3.0:1790772519.197628:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796578560 00010000:00010000:3.0:1790772519.197672:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.197711:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1790772519.197721:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:2355:x1877760796578560:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772519.197736:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772519.197743:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.197777:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.197802:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519200/0xd3c7635991be1c9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c1 expref: 56 pid: 5857 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.197819:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772519.197824:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.197833:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.197842:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.197869:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772519.197960:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:2355:x1877760796578560:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 239us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.197968:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:3.0:1790772519.198026:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.198035:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772519.198053:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790772519.198220:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.198249:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.198257:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772519.198259:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790772519.198261:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519c00, rc 0) 00000100:00100000:3.0:1790772519.198286:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10523:x1877760796578304:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 20311us (20574us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790772519.198293:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:3.0:1790772519.207492:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.208037:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796578816 00000100:00100000:1.0:1790772519.208050:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796578816 00000100:00100000:1.0:1790772519.208123:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1790772519.208134:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10523:x1877760796578816:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:1.0:1790772519.208151:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772519.208175:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509ac expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.208195:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772519.208200:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772519.208285:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:10523:x1877760796578816:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 141us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.208294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1790772519.217230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.217289:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796578944 00000100:00100000:3.0:1790772519.217297:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796578944 00000100:00100000:3.0:1790772519.217343:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:3.0:1790772519.217350:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:10523:x1877760796578944:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:3.0:1790772519.217438:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.217452:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.217460:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772519.217638:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790772519.217713:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:10523:x1877760796578944:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 362us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.217721:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:3.0:1790772519.220476:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.220632:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796579072 00000100:00100000:1.0:1790772519.220643:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796579072 00000100:00100000:1.0:1790772519.220700:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:1.0:1790772519.220710:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:10523:x1877760796579072:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772519.220731:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772519.220751:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509dd expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.220828:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.220839:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.220859:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.220872:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.220932:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772519.220935:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772519.220940:0:5857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.220948:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db200, rc 0) 00000100:00100000:1.0:1790772519.220995:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10523:x1877760796579072:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 288us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.221001:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000001:00080000:0.0:1790772519.253866:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1790772519.253902:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:0.0:1790772519.691159:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772519.691171:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772519.691249:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790772519.691256:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790772519.691287:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772519.691491:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c62680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813372288:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790772519.691594:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772519.708315:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c62680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813372288:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772519.709633:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.709750:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796579200 00000100:00100000:3.0:1790772519.709761:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796579200 00000100:00100000:3.0:1790772519.709830:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1790772519.709841:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10524:x1877760796579200:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772519.709911:0:5856:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790772519.710056:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10524:x1877760796579200:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 216us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.710063:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1790772519.724456:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.724637:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796579328 00000100:00100000:0.0:1790772519.724651:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796579328 00000100:00100000:0.0:1790772519.724719:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:0.0:1790772519.724732:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10524:x1877760796579328:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790772519.724809:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724828:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724840:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724925:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724934:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724940:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724963:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724971:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.724993:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772519.725032:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790772519.725036:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772519.725050:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725061:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725067:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725074:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725079:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772519.725083:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725090:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725101:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:0.0:1790772519.725104:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772519.725108:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725114:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1cf2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725136:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725142:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725148:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725153:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772519.725155:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725160:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725167:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9328946b8700) 00010000:00010000:0.0:1790772519.725169:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772519.725172:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725177:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1cf9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725191:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725196:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725201:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725210:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772519.725226:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725232:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725239:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772519.725242:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772519.725244:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.725250:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772519.725339:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10524:x1877760796579328:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 608us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772519.725348:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:0.0:1790772519.730208:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.730492:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796579584 00000100:00100000:3.0:1790772519.730503:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796579584 00000100:00100000:3.0:1790772519.730569:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:3.0:1790772519.730579:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:10524:x1877760796579584:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772519.730600:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772519.730620:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1d07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509e4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.730714:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.730729:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.730742:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772519.730754:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790772519.730860:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731103:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731109:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731115:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772519.731120:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731128:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731142:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:3.0:1790772519.731145:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772519.731150:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731155:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731203:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1d07 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509e4 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731459:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:3.0:1790772519.731463:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772519.731468:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1d07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509e4 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.731480:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8400, rc 0) 00000100:00100000:3.0:1790772519.731592:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:10524:x1877760796579584:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1013us (1393us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1790772519.731601:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1790772519.736111:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.740571:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796579712 00000100:00100000:0.0:1790772519.740588:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796579712 00000100:00100000:0.0:1790772519.740654:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:0.0:1790772519.740665:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:10524:x1877760796579712:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772519.740703:0:5857:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772519.740838:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:10524:x1877760796579712:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 175us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772519.740846:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:0.0:1790772519.753098:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.753626:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796579968 00000100:00100000:2.0:1790772519.753638:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796579968 00000100:00100000:2.0:1790772519.753704:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:2.0:1790772519.753715:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:10524:x1877760796579968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772519.753740:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772519.753743:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790772519.753772:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509c8 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.753795:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:2.0:1790772519.753802:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772519.753817:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509eb expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772519.754744:0:8380:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790772519.756829:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1d23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.756854:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.756867:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.759182:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509eb expref: 58 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.761889:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509eb expref: 57 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.761940:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9328a1803500) 00010000:00010000:2.0:1790772519.761943:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772519.761948:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518800, rc 0) 00000100:00100000:2.0:1790772519.762101:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:10524:x1877760796579968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 8385us (9010us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1790772519.762112:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:2.0:1790772519.772752:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.772843:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796580224 00000100:00100000:0.0:1790772519.772853:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796580224 00000100:00100000:0.0:1790772519.773099:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1790772519.773110:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:10524:x1877760796580224:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772519.773176:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772519.773206:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1d23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509eb expref: 57 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773243:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9328a1803500) 00010000:00010000:0.0:1790772519.773254:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772519.773284:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773300:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773311:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773333:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773341:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773349:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773425:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773452:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773459:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773466:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772519.773470:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773478:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773487:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:0.0:1790772519.773489:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772519.773493:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773499:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1d31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773509:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773515:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773520:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773525:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772519.773534:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773542:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773550:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8789f9f4 (ffff9328946b8700) 00010000:00010000:0.0:1790772519.773553:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772519.773556:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.773562:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1d38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8789f9f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772519.773658:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:10524:x1877760796580224:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 550us (1027us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772519.773666:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:1.0:1790772519.793613:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.793933:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796580352 00000100:00100000:3.0:1790772519.793945:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796580352 00000100:00100000:3.0:1790772519.794012:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:3.0:1790772519.794023:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:10524:x1877760796580352:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772519.794046:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772519.794068:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509f2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.794106:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.794119:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.794131:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.794247:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.794278:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.794288:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:3.0:1790772519.794291:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790772519.794301:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8200, rc 0) 00000100:00100000:3.0:1790772519.796451:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:10524:x1877760796580352:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2415us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772519.796467:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:3.0:1790772519.811190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.811328:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796580608 00000100:00100000:1.0:1790772519.811340:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796580608 00000100:00100000:1.0:1790772519.811413:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:1.0:1790772519.811440:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:10524:x1877760796580608:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772519.811545:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.811566:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.811580:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772519.812036:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1790772519.812048:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340632172314ns, next at 341632169840ns, rc = 0 00000004:00010000:1.0:1790772519.812140:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000039f01739 reply state 000000009ea64785 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772519.812151:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772519.812258:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:10524:x1877760796580608:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 818us (1077us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1790772519.812266:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1790772519.815163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.815283:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796580736 00000100:00100000:2.0:1790772519.815293:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796580736 00000100:00100000:2.0:1790772519.815361:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:2.0:1790772519.815372:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:10524:x1877760796580736:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772519.815405:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772519.815429:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a509f9 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.815496:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 60 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.815511:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 60 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.815532:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:2.0:1790772519.815535:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772519.815539:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518000, rc 0) 00000100:00100000:2.0:1790772519.815603:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:10524:x1877760796580736:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 233us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772519.815624:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00010000:00010000:0.0:1790772519.816184:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.816197:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.816203:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.816209:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772519.816214:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.816222:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.816247:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:0.0:1790772519.816250:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772519.816254:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772519.816271:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.824429:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.824587:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796580864 00000100:00100000:0.0:1790772519.824599:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796580864 00000100:00100000:0.0:1790772519.824658:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:0.0:1790772519.824681:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796580864:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790772519.825064:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796580864:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 396us (644us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790772519.825071:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:1.0:1790772519.845639:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.845838:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796581120 00000100:00100000:0.0:1790772519.845849:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796581120 00000100:00100000:0.0:1790772519.845956:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1790772519.845968:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:10524:x1877760796581120:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790772519.853127:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:10524:x1877760796581120:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 7148us (7485us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790772519.853145:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:3.0:1790772519.860847:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.860990:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796581376 00000100:00100000:0.0:1790772519.861001:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796581376 00000100:00100000:0.0:1790772519.861062:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1790772519.861072:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:10524:x1877760796581376:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772519.861226:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:10524:x1877760796581376:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 154us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772519.861234:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:3.0:1790772519.864747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.864911:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796581504 00000100:00100000:2.0:1790772519.864931:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796581504 00000100:00100000:2.0:1790772519.864985:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1790772519.864995:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:10524:x1877760796581504:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772519.865016:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772519.865036:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a00 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.865125:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.865142:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.865154:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772519.865190:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772519.865210:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.865237:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be1d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a00 expref: 62 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.865257:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a00 expref: 61 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.865275:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:2.0:1790772519.865292:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790772519.865296:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519000, rc 0) 00000100:00100000:2.0:1790772519.865390:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:10524:x1877760796581504:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 395us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772519.865398:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:3.0:1790772519.872629:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772519.872821:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796581632 00000100:00100000:2.0:1790772519.872833:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796581632 00000100:00100000:2.0:1790772519.872930:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1790772519.872949:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2354:x1877760796581632:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772519.872968:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772519.872988:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a07 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772519.873017:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd0528, blocks: 0x1 00010000:00010000:2.0:1790772519.873038:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1790772519.873043:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772519.873052:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 10 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.873068:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 10 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772519.873081:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518a00, rc 0) 00000100:00100000:2.0:1790772519.873142:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2354:x1877760796581632:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 203us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772519.873149:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1790772519.876322:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.876480:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796581888 00000100:00100000:1.0:1790772519.876492:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796581888 00000100:00100000:1.0:1790772519.876550:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:1.0:1790772519.876560:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:10524:x1877760796581888:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772519.876686:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:10524:x1877760796581888:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 127us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.876694:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:3.0:1790772519.884424:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.885048:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582016 00000100:00100000:1.0:1790772519.885077:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582016 00000100:00100000:1.0:1790772519.889217:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1790772519.889246:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:10524:x1877760796582016:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772519.889476:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772519.889499:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a0e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.889535:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.889545:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772519.889549:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772519.889555:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.889592:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.889607:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772519.889622:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813372416:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772519.889780:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328918640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772519.895763:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813372416:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772519.895799:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772519.895843:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dae00, rc 0) 00000100:00100000:1.0:1790772519.895952:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:10524:x1877760796582016:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 6711us (11528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772519.895962:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1790772519.902140:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772519.902517:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582144 00000100:00100000:3.0:1790772519.902529:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582144 00010000:00010000:3.0:1790772519.902575:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.902623:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1790772519.902633:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2356:x1877760796582144:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772519.902649:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772519.902672:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.902686:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.902708:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065530b06/0xd3c7635991be1d69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a07 expref: 11 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.902751:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772519.902755:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772519.902764:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.902775:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772519.902817:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772519.902832:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5840:1877760813372544:192.168.201.34@tcp:105: 00000100:00100000:3.0:1790772519.902992:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772519.921020:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772519.921107:0:6710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582272 00000100:00100000:1.0:1790772519.921117:0:6710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582272 00000100:00100000:2.0:1790772519.921141:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5840:1877760813372544:192.168.201.34@tcp:105: 00002000:00100000:1.0:1790772519.921165:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9328c100b100 x1877760796582272/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:110/0 lens 504/0 e 0 to 0 dl 1790772530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790772519.921170:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1790772519.921174:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c100b100 with x1877760796582272 ext(0->12) 00002000:00010000:1.0:1790772519.921180:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c100b100 00000100:00100000:1.0:1790772519.921202:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1790772519.921211:0:6710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2354:x1877760796582272:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790772519.921243:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2356:x1877760796582144:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 18611us (19113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772519.921251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:1.0:1790772519.921681:0:6710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:2354:x1877760796582272:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 469us (672us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790772519.921688:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:1.0:1790772519.921694:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9328c100b100 x1877760796582272/t4294967308(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:110/0 lens 504/448 e 0 to 0 dl 1790772530 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772519.921702:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c100b100 with x1877760796582272 ext(0->12) 00002000:00010000:1.0:1790772519.921705:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c100b100 00000100:00100000:2.0:1790772519.938585:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772519.938712:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582400 00000100:00100000:0.0:1790772519.938724:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582400 00000100:00100000:0.0:1790772519.938789:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:0.0:1790772519.938801:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:10524:x1877760796582400:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790772519.999145:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1790772519.999188:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9327836df600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1790772519.999193:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf4bef00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9327836df480 00000020:00080000:3.0:1790772519.999197:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf4bea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9328c13a6800 00000004:00080000:3.0:1790772519.999215:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1790772519.999250:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1790772519.999563:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1790772519.999591:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1790772519.999616:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff932881377600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1790772519.999620:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328830e0800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9328aa8e83c0 00000020:00080000:3.0:1790772519.999642:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328830e0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff932888332c00 00000020:00080000:3.0:1790772519.999661:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1790772520.000199:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932893c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813372672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790772520.000283:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772520.000480:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813372672 00000100:00100000:0.0:1790772520.000489:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813372672 00000100:00100000:0.0:1790772520.000552:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772520.000563:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813372672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790772520.000596:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1790772520.000644:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd0526, atime: 0x6abd0527, ctime: 0x6abd0526, blocks: 0xb 00010000:00010000:0.0:1790772520.000652:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.000670:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1790772520.000674:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772520.000681:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.000698:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.000723:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.000732:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.000752:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790772520.001445:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813372672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 881us (1159us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790772520.001454:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1790772520.001481:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772520.001489:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.001500:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772520.001504:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.001516:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.001533:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.001541:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d17c6749/0xd3c7635991be1d77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.001567:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772520.001569:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772520.001571:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772520.002048:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10524:x1877760796582400:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 63246us (63471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.002059:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000020:00080000:3.0:1790772520.002233:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:2.0:1790772520.002373:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772520.002429:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790772520.002436:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1790772520.002457:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93289ee89180, transno 4294967301 00000004:00080000:2.0:1790772520.002467:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1790772520.002487:0:3315:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff932893c60700 x1877760813372672/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790772535 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790772520.002501:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff932893c60700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790772520.002508:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932893c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813372672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790772520.002654:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772520.002668:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813372928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790772520.002723:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772520.002764:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813372928 00000100:00100000:3.0:1790772520.002770:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813372928 00000100:00100000:3.0:1790772520.002814:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790772520.002824:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813372928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772520.005554:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813372800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790772520.005637:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1790772520.006530:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790772520.006537:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790772520 00002000:00010000:3.0:1790772520.006540:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790772520.006542:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790772520 -> 1790772520 00002000:00010000:3.0:1790772520.006544:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790772520.006603:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1877760813372928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3779us (3878us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790772520.006615:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790772520.006638:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813372800 00000100:00100000:3.0:1790772520.006646:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813372800 00000100:00100000:3.0:1790772520.006675:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790772520.006682:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813372800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790772520.006708:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1790772520.006727:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.006752:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.006776:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1790772520.006780:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772520.006785:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.006817:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.006831:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 11 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772520.006845:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813373056:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772520.007669:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772520.007776:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772520.007857:0:6705:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790772520.007866:0:6705:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1790772520.008014:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328c100ad80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1790772520.008021:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813372928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790772520.008114:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582528 00000100:00100000:3.0:1790772520.008120:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582528 00000100:00100000:2.0:1790772520.008257:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1790772520.008274:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:2355:x1877760796582528:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790772520.011832:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772520.011863:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582656 00000100:00100000:0.0:1790772520.011872:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582656 00010000:00010000:0.0:1790772520.011936:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 13 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772520.012028:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813373056:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772520.012052:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.012054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1790772520.012063:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932893c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2354:x1877760796582656:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772520.012079:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772520.012085:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 13 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.012175:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 13 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.012199:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be1b39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5096d expref: 13 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.012646:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772520.012651:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772520.012657:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.012750:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.013787:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772520.013857:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932893c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:2354:x1877760796582656:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1789us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772520.013867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00010000:00010000:1.0:1790772520.014002:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014021:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014033:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014041:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014062:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790772520.014631:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3316:x1877760813372800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7947us (8992us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790772520.014640:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1790772520.014669:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772520.014676:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014684:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8c00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772520.014688:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014697:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014715:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014729:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be1d7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.014754:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772520.014756:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772520.014757:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790772520.015912:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328c100a300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790772520.016410:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813372800:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1790772520.080671:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1790772520.080689:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1790772520.080696:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1790772520.080711:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1790772520.080916:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796582528:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 72595us (73092us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772520.080929:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1790772520.084037:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772520.084140:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796582912 00000100:00100000:1.0:1790772520.084150:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796582912 00000100:00100000:1.0:1790772520.084211:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:1.0:1790772520.084221:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10524:x1877760796582912:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772520.084278:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772520.084306:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be1d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a00 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.084327:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:1.0:1790772520.084331:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772520.084363:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.084377:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.084387:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772520.084656:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000069221517 reply state 00000000948f50cf transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.084666:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772520.084772:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:10524:x1877760796582912:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 552us (743us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790772520.084780:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00010000:00010000:0.0:1790772520.086567:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.086583:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.086590:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.086596:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772520.086601:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.086609:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.086624:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:0.0:1790772520.086626:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772520.086631:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.086653:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1d85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.087083:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772520.087593:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796583040 00000100:00100000:3.0:1790772520.087603:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796583040 00000100:00100000:3.0:1790772520.087660:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1790772520.087678:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796583040:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790772520.087923:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790772520.087927:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790772520 -> 1790772519 00002000:00010000:3.0:1790772520.087929:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790772519 00002000:00010000:3.0:1790772520.087931:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790772520 -> 1790772519 00002000:00010000:3.0:1790772520.087933:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790772520.088223:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796583040:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 545us (1140us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790772520.088232:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1790772520.090699:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772520.090787:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796583296 00000100:00100000:3.0:1790772520.090796:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796583296 00000100:00100000:3.0:1790772520.090852:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:3.0:1790772520.090863:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:10524:x1877760796583296:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790772520.090972:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.090992:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.091002:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.091037:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.091053:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 15 pid: 5856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772520.091067:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813373184:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772520.091145:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75c540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772520.093298:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813373184:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772520.093325:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:0.0:1790772520.093331:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.093396:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796583424 00000100:00100000:1.0:1790772520.093403:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796583424 00010000:00010000:1.0:1790772520.093437:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 16 pid: 5856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.093474:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1790772520.093483:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:2354:x1877760796583424:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772520.093500:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772520.093507:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 16 pid: 5856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.093517:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 16 pid: 5856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.093536:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f2 expref: 16 pid: 5856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.093555:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:1.0:1790772520.093559:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.093579:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.093587:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.093616:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772520.093676:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:2354:x1877760796583424:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 193us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.093683:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00010000:00010000:0.0:1790772520.093715:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093723:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093751:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093759:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093765:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093772:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772520.093776:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093783:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093791:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:0.0:1790772520.093800:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790772520.093805:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.093811:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1d8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.093862:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10524:x1877760796583296:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 3001us (3171us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790772520.093870:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1790772520.096120:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772520.096196:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796583552 00000100:00100000:1.0:1790772520.096205:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796583552 00000100:00100000:1.0:1790772520.096257:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1790772520.096267:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796583552:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790772520.096308:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.096328:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.096338:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772520.096342:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772520.096347:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.096380:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.096415:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 7 pid: 6704 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.096429:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813373312:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772520.096512:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfaece40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772520.099146:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813373312:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772520.099177:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772520.105432:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772520.105831:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796583680 00000100:00100000:0.0:1790772520.105841:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796583680 00010000:00010000:0.0:1790772520.105928:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 8 pid: 6704 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.105982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:0.0:1790772520.105994:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796583680:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772520.106013:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772520.106041:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 8 pid: 6704 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.106056:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 8 pid: 6704 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.106100:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f07ec766/0xd3c7635991be1d70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a0e expref: 8 pid: 6704 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.106119:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772520.106124:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772520.106130:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.106140:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.106167:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772520.106230:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796583680:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 237us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772520.106237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00010000:00010000:1.0:1790772520.106596:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106607:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106637:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106646:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106655:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106662:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772520.106667:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106690:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106706:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.106714:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be1d93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.106786:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796583552:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 10519us (10673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.106795:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:2.0:1790772520.108979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772520.109116:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796583936 00000100:00100000:0.0:1790772520.109126:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796583936 00000100:00100000:0.0:1790772520.109173:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:0.0:1790772520.109184:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10524:x1877760796583936:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790772520.109268:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109287:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109299:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109520:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109533:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109542:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109576:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.109591:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 15 pid: 8380 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.109605:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813373440:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772520.109688:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772520.120169:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772520.120287:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813373440:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772520.120316:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.120393:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796584064 00000100:00100000:1.0:1790772520.120400:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796584064 00010000:00010000:1.0:1790772520.120439:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 16 pid: 8380 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.120481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1790772520.120491:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+16:2355:x1877760796584064:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772520.120506:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772520.120513:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 16 pid: 8380 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.120527:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 16 pid: 8380 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.120567:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be1d54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509f9 expref: 16 pid: 8380 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.120584:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:1.0:1790772520.120590:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.120600:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.120608:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.120636:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772520.120703:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:2355:x1877760796584064:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 213us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.120711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00010000:00010000:0.0:1790772520.120773:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.120782:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772520.120986:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1790772520.121132:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1790772520.121177:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1790772520.121261:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813373568:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790772520.121309:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772520.121333:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772520.121431:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813373568 00000100:00100000:1.0:1790772520.121436:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813373568 00000100:00100000:1.0:1790772520.121467:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772520.121474:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1877760813373568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790772520.122048:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1877760813373568:12345-0@lo:1000:mdt00_000.0 Request processed in 573us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.122057:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772520.122124:0:5855:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790772520.122130:0:5855:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1790772520.122145:0:5855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328c100ad80, transno 4294967309 00000100:00100000:0.0:1790772520.122168:0:5855:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9328c100a300 x1877760813372800/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790772536 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772520.122179:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813373568:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790772520.122624:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1790772520.122685:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813373696:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790772520.122716:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772520.122733:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772520.123124:0:5861:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813373696 00000100:00100000:2.0:1790772520.123131:0:5861:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813373696 00000100:00100000:2.0:1790772520.123165:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772520.123174:0:5861:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5855:x1877760813373696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790772520.123454:0:5861:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5855:x1877760813373696:12345-0@lo:1000:mdt00_000.0 Request processed in 280us (736us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790772520.123462:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772520.123565:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813373696:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790772520.128440:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128460:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128467:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128497:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772520.128501:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128509:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128526:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65000) 00010000:00010000:2.0:1790772520.128529:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772520.128534:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128540:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1da1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128576:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128584:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128590:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128596:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772520.128599:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128605:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128624:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:2.0:1790772520.128627:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772520.128636:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128649:0:5855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128658:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772520.128701:0:5855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772520.128718:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813373824:192.168.201.34@tcp:105: 00000100:00100000:2.0:1790772520.128802:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772520.135807:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813373824:192.168.201.34@tcp:105: 00010000:00010000:1.0:1790772520.135843:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.135928:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be1ce4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.135967:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.135984:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.135997:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136007:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136014:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136020:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136026:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772520.136030:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136117:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136129:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772520.136132:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772520.136135:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136147:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1da8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136159:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136165:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136171:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136176:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772520.136179:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136186:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136194:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772520.136196:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772520.136199:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.136204:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1d9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772520.136446:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10524:x1877760796583936:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 27262us (27474us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1790772520.136457:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000020:00080000:1.0:1790772520.136473:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790772520.136637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000040:00080000:0.0:1790772520.136909:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772520.136915:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772520.137415:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1790772520.137424:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772520.137636:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796584192 00000100:00100000:1.0:1790772520.137646:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796584192 00000100:00100000:1.0:1790772520.137698:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:1.0:1790772520.137707:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10523:x1877760796584192:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:1.0:1790772520.137821:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10523:x1877760796584192:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 114us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.137829:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1790772520.148004:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772520.148057:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772520.148163:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796584448 00000100:00100000:1.0:1790772520.148174:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796584448 00000100:00100000:1.0:1790772520.148229:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:1.0:1790772520.148240:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10523:x1877760796584448:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:1.0:1790772520.148614:0:8380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1790772520.148709:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10523:x1877760796584448:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 470us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772520.148717:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:3.0:1790772520.148859:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796584704 00000100:00100000:3.0:1790772520.148864:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796584704 00000100:00100000:3.0:1790772520.148935:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:3.0:1790772520.148944:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:10524:x1877760796584704:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790772520.149480:0:5859:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790772520.149584:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1790772520.149629:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.149645:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.149658:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.149667:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.149674:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.149681:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772520.149712:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790772520.149777:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:10524:x1877760796584704:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 832us (1718us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1790772520.149785:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000020:00080000:3.0:1790772520.149789:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772520.150146:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772520.150155:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.150162:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772520.150166:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.150175:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.150189:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff932884f65500) 00010000:00010000:1.0:1790772520.150192:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790772520.150265:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.150272:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be1daf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.150290:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772520.150292:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772520.150293:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772520.202956:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772520.205207:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796584832 00000100:00100000:0.0:1790772520.205223:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796584832 00000100:00100000:0.0:1790772520.205300:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:0.0:1790772520.205311:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:10526:x1877760796584832:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772520.205347:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772520.205373:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a15 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205469:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205485:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205499:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205514:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205522:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205530:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205753:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205764:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205774:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205807:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.205832:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 21 pid: 5855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.205847:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813373952:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772520.206199:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772520.215044:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813373952:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772520.215074:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772520.227102:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772520.227228:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796585088 00000100:00100000:1.0:1790772520.227239:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796585088 00000100:00100000:1.0:1790772520.227299:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1790772520.227309:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:5594:x1877760796585088:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790772520.227570:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:5594:x1877760796585088:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 259us (474us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1790772520.227584:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1790772520.235409:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772520.235503:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796585216 00000100:00100000:0.0:1790772520.235512:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796585216 00010000:00010000:0.0:1790772520.235553:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 23 pid: 5855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772520.235594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1790772520.235604:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:2354:x1877760796585216:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772520.235619:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772520.235626:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 23 pid: 5855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.235640:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 23 pid: 5855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.235664:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1cd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509d6 expref: 23 pid: 5855 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.235681:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772520.235687:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.235697:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.235718:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772520.235749:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772520.235805:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:2354:x1877760796585216:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 202us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772520.235814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00010000:00010000:1.0:1790772520.235831:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.235842:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772520.235931:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790772520.235935:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772520.235955:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.235977:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.235985:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236006:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236012:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236018:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772520.236022:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236029:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236039:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772520.236043:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772520.236047:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236053:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1dbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236064:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236071:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236085:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236090:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772520.236094:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236100:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236111:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9328946b8700) 00010000:00010000:1.0:1790772520.236114:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772520.236118:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236123:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236160:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a15 expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236173:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a15 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772520.236180:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772520.236182:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772520.236184:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92200, rc 0) 00000100:00100000:2.0:1790772520.236297:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10526:x1877760796584832:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 30987us (33424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772520.236305:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00010000:00010000:0.0:1790772520.716130:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772521.164215:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772521.164225:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772521.164336:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790772521.164342:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772521.164464:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813374080:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790772521.165378:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a16530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772521.174386:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813374080:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772521.186060:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772521.186158:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796585344 00000100:00100000:0.0:1790772521.186169:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796585344 00000100:00100000:0.0:1790772521.187598:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:0.0:1790772521.187613:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10537:x1877760796585344:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772521.187652:0:8380:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772521.187758:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10537:x1877760796585344:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 149us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772521.187766:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00080000:2.0:1790772521.192992:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772521.196156:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772521.196262:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796585600 00000100:00100000:1.0:1790772521.196272:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796585600 00000100:00100000:1.0:1790772521.196346:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1790772521.196356:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:10537:x1877760796585600:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772521.196379:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772521.196399:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1dd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a1c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772521.196496:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1dd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772521.196511:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772521.196526:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772521.196537:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790772521.196664:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1dd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a1c expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772521.196682:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a1c expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772521.196691:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772521.196695:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772521.196698:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db800, rc 0) 00000100:00100000:1.0:1790772521.196779:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10537:x1877760796585600:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 424us (632us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1790772521.196787:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000040:00080000:0.0:1790772521.208830:0:12070:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772521.208839:0:12070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772521.208959:0:12070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790772521.208977:0:12070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772521.209125:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772521.209201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772521.209242:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796585984 00000100:00100000:0.0:1790772521.209253:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796585984 00000100:00100000:0.0:1790772521.209301:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:0.0:1790772521.209311:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10537:x1877760796585984:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790772521.209470:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.209489:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772521.209500:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796585728 00010000:00010000:0.0:1790772521.209502:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772521.209507:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796585728 00000100:00100000:1.0:1790772521.209604:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1790772521.209615:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f362a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:2357:x1877760796585728:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772521.209628:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772521.209647:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1dd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a1c expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772521.209663:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772521.209668:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772521.209729:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f362a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:2357:x1877760796585728:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 117us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772521.209737:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:0.0:1790772521.210349:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.210436:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.210444:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.210449:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772521.210453:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.210461:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.210473:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772521.210476:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772521.210487:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772521.210494:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1de7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772521.210635:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10537:x1877760796585984:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 1323us (1431us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790772521.210643:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000040:00080000:0.0:1790772521.210772:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772521.210777:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772521.212120:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790772521.212140:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772521.246022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772521.246450:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796586240 00000100:00100000:1.0:1790772521.246461:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796586240 00000100:00100000:1.0:1790772521.246520:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1790772521.246529:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:10537:x1877760796586240:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772521.246755:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:10537:x1877760796586240:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 225us (744us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790772521.246763:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00010000:00010000:1.0:1790772521.739196:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772522.188124:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772522.188161:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813374208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772522.188240:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772522.188456:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374208 00000100:00100000:2.0:1790772522.188466:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374208 00000100:00100000:2.0:1790772522.188535:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772522.188542:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813374208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772522.188573:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772522.188617:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813374208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772522.188622:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772522.188661:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813374208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772522.188921:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772522.767513:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772523.117526:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772523.117538:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772523.117587:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790772523.117599:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772523.385419:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772523.388371:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796586496 00000100:00100000:1.0:1790772523.388385:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796586496 00000100:00100000:1.0:1790772523.388467:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:1.0:1790772523.388479:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:10558:x1877760796586496:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772523.388521:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772523.388540:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a23 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772523.388633:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1df5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772523.388648:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772523.388661:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772523.388672:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790772523.388803:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a23 expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772523.388822:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a23 expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772523.388831:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772523.388845:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772523.388849:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db800, rc 0) 00000100:00100000:1.0:1790772523.388941:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10558:x1877760796586496:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 464us (3545us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1790772523.388949:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00080000:0.0:1790772523.393201:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772523.398147:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772523.398420:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796586624 00000100:00100000:0.0:1790772523.398433:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796586624 00000100:00100000:0.0:1790772523.398492:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:0.0:1790772523.398501:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10558:x1877760796586624:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1790772523.398585:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398617:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398629:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398657:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398664:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398671:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398677:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772523.398681:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398688:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398700:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:0.0:1790772523.398703:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772523.398707:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772523.398714:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772523.417861:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:10558:x1877760796586624:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 19348us (19714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772523.417904:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:0.0:1790772523.595422:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772523.595525:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796586752 00000100:00100000:2.0:1790772523.595538:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796586752 00000100:00100000:2.0:1790772523.595617:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1790772523.595628:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2356:x1877760796586752:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1790772523.595646:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772523.595681:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009322c8a6/0xd3c7635991be1e0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a2a expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772523.595707:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd0527, atime: 0x6abd0527, ctime: 0x6abd0527, blocks: 0xb 00010000:00010000:2.0:1790772523.595726:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1790772523.595731:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772523.595741:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009322c8a6/0xd3c7635991be1e0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a2a expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772523.595761:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009322c8a6/0xd3c7635991be1e0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a2a expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772523.595791:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519200, rc 0) 00000100:00100000:2.0:1790772523.595864:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2356:x1877760796586752:12345-192.168.201.34@tcp:101:cat.0 Request processed in 238us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772523.595871:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00080000:0.0:1790772523.596075:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772523.600590:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772523.600683:0:6711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796586880 00000100:00100000:1.0:1790772523.600692:0:6711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796586880 00002000:00100000:1.0:1790772523.600740:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93288f34c380 x1877760796586880/t0(0) o3->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:114/0 lens 488/0 e 0 to 0 dl 1790772534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772523.600751:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93288f34c380 with x1877760796586880 ext(0->4095) 00002000:00010000:1.0:1790772523.600757:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93288f34c380 00000100:00100000:1.0:1790772523.600788:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1790772523.600797:0:6711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796586880:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:1.0:1790772523.601079:0:6711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796586880:12345-192.168.201.34@tcp:3:cat.0 Request processed in 282us (496us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790772523.601086:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00100000:1.0:1790772523.601093:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93288f34c380 x1877760796586880/t0(0) o3->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:114/0 lens 488/4536 e 0 to 0 dl 1790772534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772523.601101:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93288f34c380 with x1877760796586880 ext(0->4095) 00002000:00010000:1.0:1790772523.601104:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93288f34c380 00000100:00100000:3.0:1790772523.724206:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813374720:0@lo:400:kworker.0 00000100:00100000:3.0:1790772523.724284:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772523.724352:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772523.724359:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813374592:0@lo:400:kworker.0 00000100:00100000:3.0:1790772523.724383:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772523.724607:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813374464:0@lo:400:kworker.0 00000100:00100000:0.0:1790772523.724639:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772523.724677:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813374976:0@lo:400:kworker.0 00000100:00100000:0.0:1790772523.724699:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772523.724715:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772523.724720:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813374336:0@lo:400:kworker.0 00000100:00100000:0.0:1790772523.724746:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772523.724769:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813374848:0@lo:400:kworker.0 00000100:00100000:0.0:1790772523.724791:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772523.724818:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374336 00000100:00100000:0.0:1790772523.724841:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374336 00000100:00100000:0.0:1790772523.724911:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1790772523.724920:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813374336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772523.724969:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b1555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813374336:12345-0@lo:400:kworker.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772523.724976:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1790772523.725023:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813374336:0@lo:400:kworker.0 00000100:00100000:2.0:1790772523.725256:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374720 00000100:00100000:2.0:1790772523.725261:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374720 00000100:00100000:2.0:1790772523.725297:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374976 00000100:00100000:2.0:1790772523.725301:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374976 00000100:00100000:2.0:1790772523.725334:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790772523.725341:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813374720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772523.725383:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813374720:12345-0@lo:400:kworker.0 Request processed in 42us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772523.725389:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790772523.725402:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790772523.725408:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813374976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772523.725441:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813374976:12345-0@lo:400:kworker.0 Request processed in 33us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772523.725447:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1790772523.725465:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772523.725489:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813374720:0@lo:400:kworker.0 00000100:00100000:2.0:1790772523.725513:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813374976:0@lo:400:kworker.0 00000100:00100000:1.0:1790772523.725612:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374592 00000100:00100000:1.0:1790772523.725618:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374592 00000100:00100000:1.0:1790772523.725673:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374464 00000100:00100000:1.0:1790772523.725677:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374464 00000100:00100000:1.0:1790772523.725689:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813374848 00000100:00100000:1.0:1790772523.725692:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813374848 00000100:00100000:1.0:1790772523.725707:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790772523.725714:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813374592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772523.725759:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813374592:12345-0@lo:400:kworker.0 Request processed in 45us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772523.725766:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790772523.725793:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790772523.725799:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813374464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772523.725850:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813374464:12345-0@lo:400:kworker.0 Request processed in 50us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772523.725856:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790772523.725868:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790772523.725899:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813374848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772523.725927:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813374848:12345-0@lo:400:kworker.0 Request processed in 54us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772523.725933:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790772523.725959:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813374592:0@lo:400:kworker.0 00000100:00080000:2.0:1790772523.726478:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772523.726503:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813374848:0@lo:400:kworker.0 00000100:00100000:2.0:1790772523.726514:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813374464:0@lo:400:kworker.0 00010000:00010000:0.0:1790772523.787227:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772524.146978:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772524.147017:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772524.147068:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772524.147116:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772524.147142:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772524.147170:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587520 00000100:00100000:1.0:1790772524.147180:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587520 00000100:00100000:1.0:1790772524.147260:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587136 00000100:00100000:1.0:1790772524.147264:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587136 00000100:00100000:1.0:1790772524.147288:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:1.0:1790772524.147298:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796587520:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772524.147376:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796587520:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772524.147383:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:1.0:1790772524.147403:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:3.0:1790772524.147483:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587008 00000100:00100000:3.0:1790772524.147488:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587008 00000100:00100000:2.0:1790772524.147489:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587264 00000100:00100000:2.0:1790772524.147511:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587264 00000100:00100000:3.0:1790772524.147521:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 293 00000100:00100000:3.0:1790772524.147532:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796587008:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772524.147549:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587392 00000100:00100000:2.0:1790772524.147553:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587392 00000100:00100000:3.0:1790772524.147567:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796587008:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772524.147575:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 293 00000100:00100000:2.0:1790772524.147583:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:2.0:1790772524.147593:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796587264:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:3.0:1790772524.147625:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772524.147626:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796587264:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00080000:3.0:1790772524.147632:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772524.147637:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1790772524.147648:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:3.0:1790772524.147658:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2357:x1877760796587392:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772524.147690:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2357:x1877760796587392:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772524.147696:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:1.0:1790772524.148258:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:2357:x1877760796587136:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772524.148313:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:2357:x1877760796587136:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 887us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772524.155128:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:1.0:1790772524.235295:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813375104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772524.235379:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772524.235443:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375104 00000100:00100000:0.0:1790772524.235454:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375104 00000100:00100000:2.0:1790772524.236238:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772524.236251:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1877760813375104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772524.236290:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772524.236352:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1877760813375104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772524.236360:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790772524.236458:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813375104:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1790772524.402563:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1790772524.836259:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772525.349811:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1790772525.349828:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9327836df3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1790772525.349833:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf4be200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9327836dfe40 00000020:00080000:3.0:1790772525.349836:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf4be000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93289077ac00 00000001:00080000:3.0:1790772525.351856:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1790772525.351907:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1790772525.351926:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1790772525.352151:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1790772525.365165:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1790772525.365182:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1790772525.365189:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1790772525.835116:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772526.866099:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772527.308374:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772527.308399:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813375232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772527.308471:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772527.308577:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375232 00000100:00100000:0.0:1790772527.308586:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375232 00000100:00100000:0.0:1790772527.308654:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790772527.308664:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813375232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772527.308722:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772527.308794:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813375232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772527.308801:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790772527.308841:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1790772527.308846:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff932893c60700, transno 4294967304 00000100:00100000:0.0:1790772527.308863:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813375232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790772527.309966:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1790772527.371229:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772527.371241:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772527.371283:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790772527.371290:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790772527.884787:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772528.844243:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813375488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844331:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.844391:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813376000:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844414:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.844447:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772528.844452:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813375360:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844481:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.844503:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813375872:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844521:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.844544:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813375616:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844563:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.844626:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772528.844633:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba66b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813375744:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844654:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772528.844689:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376000 00000100:00100000:0.0:1790772528.844697:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376000 00000100:00100000:0.0:1790772528.844759:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375744 00000100:00100000:0.0:1790772528.844763:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375744 00000100:00100000:0.0:1790772528.844797:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790772528.844805:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813376000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844860:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813376000:12345-0@lo:400:kworker.0 Request processed in 54us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.844867:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790772528.844915:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790772528.844922:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813375744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.844957:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813375744:12345-0@lo:400:kworker.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.844963:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790772528.844980:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375360 00000100:00100000:0.0:1790772528.844984:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375360 00000100:00100000:0.0:1790772528.845009:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790772528.845015:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813375360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845045:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813375360:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.845051:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790772528.845077:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375488 00000100:00100000:0.0:1790772528.845081:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375488 00000100:00100000:0.0:1790772528.845102:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375872 00000100:00100000:0.0:1790772528.845104:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375872 00000100:00100000:0.0:1790772528.845117:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813375616 00000100:00100000:0.0:1790772528.845119:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813375616 00000100:00100000:0.0:1790772528.845133:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790772528.845139:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813375488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845172:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813375488:12345-0@lo:400:kworker.0 Request processed in 33us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.845188:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790772528.845202:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790772528.845207:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813375872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845235:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813375872:12345-0@lo:400:kworker.0 Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.845240:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790772528.845250:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790772528.845256:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813375616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845282:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813375616:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772528.845288:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1790772528.845313:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772528.845317:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772528.845357:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba66b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813375744:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845367:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813375616:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845393:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813375360:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845402:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813375872:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845413:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813375488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772528.845421:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1790772528.845425:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328c100a300, transno 4294967310 00000004:00080000:0.0:1790772528.845437:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1790772528.845451:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813376000:0@lo:400:kworker.0 00010000:00010000:0.0:1790772528.907573:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772529.270965:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772529.271005:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772529.271031:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772529.271063:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772529.271088:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772529.271117:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587904 00000100:00100000:2.0:1790772529.271126:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587904 00000100:00100000:2.0:1790772529.271182:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796588032 00000100:00100000:2.0:1790772529.271185:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796588032 00000100:00100000:2.0:1790772529.271210:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:2.0:1790772529.271220:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796587904:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772529.271295:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2356:x1877760796587904:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772529.271303:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:2.0:1790772529.271321:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1790772529.271328:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2356:x1877760796588032:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772529.271355:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2356:x1877760796588032:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772529.271362:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1790772529.271381:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796588160 00000100:00100000:2.0:1790772529.271384:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796588160 00000100:00100000:2.0:1790772529.271411:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587776 00000100:00100000:2.0:1790772529.271414:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587776 00000100:00100000:2.0:1790772529.271434:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:2.0:1790772529.271441:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796588160:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772529.271469:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796588160:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772529.271491:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:2.0:1790772529.271505:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:2.0:1790772529.271511:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2356:x1877760796587776:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772529.271537:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2356:x1877760796587776:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772529.271542:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00080000:2.0:1790772529.271565:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772529.271569:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772529.271571:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772529.272016:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796587648 00000100:00100000:1.0:1790772529.272022:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796587648 00000100:00100000:1.0:1790772529.272066:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 295 00000100:00100000:1.0:1790772529.272074:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796587648:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772529.272110:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796587648:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772529.272117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 295 00000100:00100000:3.0:1790772529.361215:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772529.361240:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813376128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772529.361314:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772529.361382:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376128 00000100:00100000:3.0:1790772529.361390:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376128 00000100:00100000:3.0:1790772529.361431:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772529.361440:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813376128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772529.361473:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772529.361517:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813376128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772529.361524:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772529.361720:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813376128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772529.662771:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772529.662861:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796588288 00000100:00100000:0.0:1790772529.662902:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796588288 00000100:00100000:0.0:1790772529.662965:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1790772529.662973:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10211:x1877760796588288:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790772529.663083:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10211:x1877760796588288:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 110us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772529.663088:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:1.0:1790772529.664553:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772529.664629:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796588544 00000100:00100000:0.0:1790772529.664638:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796588544 00000100:00100000:0.0:1790772529.664690:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:0.0:1790772529.664699:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:10211:x1877760796588544:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790772529.665012:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:10211:x1877760796588544:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 314us (465us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790772529.665018:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00010000:00010000:0.0:1790772529.931746:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772530.476216:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1790772530.477130:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1790772530.477208:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1790772530.477221:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1790772530.955161:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772531.984080:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772532.098316:0:12324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:48:50 (1790772530) 00000100:00100000:1.0:1790772532.436269:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813376256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772532.436397:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772532.436524:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376256 00000100:00100000:1.0:1790772532.436534:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376256 00000100:00100000:1.0:1790772532.436612:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772532.436624:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f2db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813376256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772532.436706:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772532.436784:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f2db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813376256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772532.436792:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1790772532.437098:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772532.437160:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813376256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772533.006458:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772533.963505:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813376640:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.963582:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772533.963663:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772533.963670:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813376768:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.963696:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772533.963746:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376640 00000100:00100000:2.0:1790772533.963754:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376640 00000100:00100000:2.0:1790772533.963805:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790772533.963814:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813376640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.963896:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813376640:12345-0@lo:400:kworker.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772533.963903:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790772533.963927:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376768 00000100:00100000:2.0:1790772533.963931:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376768 00000100:00100000:2.0:1790772533.963955:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790772533.963961:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813376768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.964008:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813376768:12345-0@lo:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772533.964014:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790772533.964376:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813376512:0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.964408:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772533.964436:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813377024:0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.964458:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772533.964482:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790772533.964488:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813376384:0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.964513:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772533.964538:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813376896:0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.964560:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772533.964588:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772533.964600:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813377024 00000100:00100000:1.0:1790772533.964604:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813377024 00000100:00100000:1.0:1790772533.964636:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790772533.964643:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813377024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.964705:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813377024:12345-0@lo:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772533.964712:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790772533.964731:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376384 00000100:00100000:1.0:1790772533.964735:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376384 00000100:00100000:1.0:1790772533.964758:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790772533.964773:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813376384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.964805:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813376384:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772533.964811:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790772533.964836:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376512 00000100:00100000:1.0:1790772533.964840:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376512 00000100:00100000:1.0:1790772533.964861:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813376896 00000100:00100000:1.0:1790772533.964864:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813376896 00000100:00100000:0.0:1790772533.964980:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790772533.964991:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813376512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772533.965039:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813376512:12345-0@lo:400:kworker.0 Request processed in 50us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772533.965045:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1790772533.965075:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772533.965079:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772533.965114:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813376384:0@lo:400:kworker.0 00000100:00100000:0.0:1790772533.965130:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813376512:0@lo:400:kworker.0 00000100:00100000:0.0:1790772533.965138:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813377024:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.965511:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813376768:0@lo:400:kworker.0 00000100:00100000:2.0:1790772533.965523:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813376640:0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.968790:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790772533.968814:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813376896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772533.968941:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813376896:12345-0@lo:400:kworker.0 Request processed in 139us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772533.968949:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790772533.970548:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813376896:0@lo:400:kworker.0 00010000:00010000:1.0:1790772534.027722:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772534.038398:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772534.038512:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796588800 00000100:00100000:0.0:1790772534.038524:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796588800 00000100:00100000:0.0:1790772534.038606:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:0.0:1790772534.038617:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:11269:x1877760796588800:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772534.038644:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772534.038925:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a31 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039012:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039031:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039220:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039289:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039298:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039305:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039665:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039676:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.039683:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772534.039693:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790772534.039845:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790772534.040113:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790772534.040311:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040318:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040323:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772534.040327:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040335:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040347:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9328946b8100) 00010000:00010000:0.0:1790772534.040350:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772534.040354:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040373:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1e18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040387:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040393:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040399:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040404:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772534.040407:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040413:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040421:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9328829d4f00) 00010000:00010000:0.0:1790772534.040423:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772534.040426:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.040431:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1e1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.044242:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a31 expref: 16 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.044269:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a31 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772534.044285:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:0.0:1790772534.044288:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772534.044292:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92400, rc 0) 00000100:00100000:0.0:1790772534.044361:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:11269:x1877760796588800:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 5746us (5974us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1790772534.044370:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:2.0:1790772534.056243:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772534.056357:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796588928 00000100:00100000:1.0:1790772534.056368:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796588928 00000100:00100000:1.0:1790772534.056425:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:1.0:1790772534.056434:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:11269:x1877760796588928:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790772534.056547:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:11269:x1877760796588928:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 114us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772534.056553:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:3.0:1790772534.061982:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772534.062414:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589056 00000100:00100000:2.0:1790772534.062424:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589056 00000100:00100000:2.0:1790772534.062490:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772534.062501:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:2355:x1877760796589056:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772534.062516:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772534.062541:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a31 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772534.062561:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:2.0:1790772534.062566:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772534.062627:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2355:x1877760796589056:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 128us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772534.062635:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1790772534.388095:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772534.388142:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772534.388179:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772534.388223:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589440 00000100:00100000:2.0:1790772534.388224:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772534.388234:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589440 00000100:00100000:2.0:1790772534.388252:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589568 00000100:00100000:2.0:1790772534.388268:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589568 00000100:00100000:3.0:1790772534.388291:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589312 00000100:00100000:3.0:1790772534.388294:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589312 00000100:00100000:2.0:1790772534.388299:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:2.0:1790772534.388309:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796589568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772534.388311:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1790772534.388317:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796589440:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772534.388380:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2357:x1877760796589440:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772534.388397:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1790772534.388403:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589184 00000100:00100000:0.0:1790772534.388407:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589184 00000100:00100000:3.0:1790772534.388418:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1790772534.388423:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796589312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772534.388432:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 297 00000100:00100000:0.0:1790772534.388438:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796589184:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:1.0:1790772534.388532:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772534.388537:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772534.388539:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772534.389194:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2357:x1877760796589568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 884us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772534.389204:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:1.0:1790772534.394136:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2357:x1877760796589184:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 5685us (6038us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772534.394164:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 297 00000100:00100000:2.0:1790772534.397394:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2357:x1877760796589312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 8957us (9201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772534.397409:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1790772534.480302:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813377152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772534.480376:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772534.489357:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813377152 00000100:00100000:2.0:1790772534.489373:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813377152 00000100:00100000:2.0:1790772534.489437:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772534.489448:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813377152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772534.489489:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772534.489580:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813377152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (9203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772534.489587:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772534.494551:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813377152:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1790772534.541251:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772534.541259:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772534.541815:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790772534.541824:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790772535.055261:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772535.588618:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1790772536.081247:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772536.306223:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772536.308475:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589696 00000100:00100000:3.0:1790772536.308491:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589696 00000100:00100000:3.0:1790772536.308570:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1790772536.308581:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:11312:x1877760796589696:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772536.308601:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772536.308715:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a38 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.308782:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.308799:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.308810:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.308825:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.308832:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.308838:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790772536.309215:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772536.309583:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309594:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309601:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309607:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772536.309623:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309631:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309643:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:3.0:1790772536.309647:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772536.309652:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309719:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309739:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309744:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309749:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309762:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772536.309765:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309771:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309780:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff932884f65e00) 00010000:00010000:3.0:1790772536.309783:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772536.309786:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309791:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309834:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1e34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a38 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309844:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:3.0:1790772536.309847:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772536.309850:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a38 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.309859:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8400, rc 0) 00000100:00100000:3.0:1790772536.310368:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:11312:x1877760796589696:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1786us (4148us total) trans 0 rc 301/301 00000100:00100000:3.0:1790772536.310378:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:2.0:1790772536.322634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.322771:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796589952 00000100:00100000:1.0:1790772536.322783:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796589952 00000100:00100000:1.0:1790772536.322850:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:1.0:1790772536.322861:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:11312:x1877760796589952:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:1.0:1790772536.323187:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772536.323219:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be17c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50878 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.323239:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328946b8300) 00010000:00010000:1.0:1790772536.323250:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772536.323487:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.323503:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.323515:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.323529:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.323537:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.323556:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772536.325653:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790772536.327795:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.327807:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.327816:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.327823:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772536.327828:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.327836:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.327853:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772536.327856:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772536.327861:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.327868:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1e49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772536.328320:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001c2717fb reply state 0000000036116f2f transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772536.328352:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772536.328460:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:11312:x1877760796589952:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 5596us (5830us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790772536.328469:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00010000:00010000:0.0:1790772536.330693:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.330714:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.330722:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.330745:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772536.330749:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.330757:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.330777:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9328a16c3300) 00010000:00010000:0.0:1790772536.330780:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772536.330787:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.330795:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1e50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772536.419872:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.420059:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796590080 00000100:00100000:0.0:1790772536.420070:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796590080 00000100:00100000:0.0:1790772536.420293:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:0.0:1790772536.420306:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:11320:x1877760796590080:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:0.0:1790772536.420396:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772536.420419:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a3f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.420485:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1e5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.420499:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.420529:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772536.420569:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772536.420573:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772536.420592:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.420627:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a3f expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.420647:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a3f expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.420716:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:0.0:1790772536.420719:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772536.420723:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93e00, rc 0) 00000100:00100000:0.0:1790772536.420790:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:11320:x1877760796590080:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 487us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772536.420805:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:2.0:1790772536.489414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.490358:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796590208 00000100:00100000:0.0:1790772536.490371:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796590208 00000100:00100000:0.0:1790772536.490445:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:0.0:1790772536.490456:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:11326:x1877760796590208:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772536.490477:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772536.490498:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490592:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490616:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490629:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490646:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490653:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490660:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490764:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490773:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.490781:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772536.491279:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790772536.491285:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772536.491308:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491334:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491340:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491347:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491364:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772536.491368:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491377:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491388:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:0.0:1790772536.491391:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772536.491396:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491402:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491415:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491420:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491426:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491438:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772536.491440:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491447:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491454:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9328829d4c00) 00010000:00010000:0.0:1790772536.491457:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772536.491460:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491465:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be1e73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491497:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be1e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a46 expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491511:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a46 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.491519:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772536.491521:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772536.491523:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92600, rc 0) 00000100:00100000:0.0:1790772536.491622:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:11326:x1877760796590208:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1167us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772536.491630:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:0.0:1790772536.499788:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772536.499987:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796590464 00000100:00100000:3.0:1790772536.500008:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796590464 00000100:00100000:3.0:1790772536.500089:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:3.0:1790772536.500101:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+15:11326:x1877760796590464:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1790772536.500141:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772536.500169:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a4d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.500337:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.500367:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.500381:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.500433:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.500442:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.500448:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790772536.501107:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790772536.501278:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501290:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501307:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501345:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501353:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501360:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501366:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772536.501370:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501378:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501391:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772536.501394:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772536.501398:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501404:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1e88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772536.501423:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e659ca3b reply state 00000000b7eb847b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772536.501432:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790772536.501471:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1e81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501486:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.501494:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:3.0:1790772536.501497:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772536.501499:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8a00, rc 0) 00000100:00100000:3.0:1790772536.501583:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11326:x1877760796590464:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1484us (1805us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790772536.501592:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 142 00010000:00010000:0.0:1790772536.506918:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.506938:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.506946:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.506953:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772536.506957:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.506965:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.506980:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff932884f65e00) 00010000:00010000:0.0:1790772536.506983:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772536.506988:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.506994:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1e8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772536.513499:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.516480:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796590592 00000100:00100000:1.0:1790772536.516499:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796590592 00000100:00100000:1.0:1790772536.516597:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1790772536.516617:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796590592:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772536.516635:0:12032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772536.516657:0:12032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a54 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772536.516687:0:12032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772536.516707:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1790772536.516712:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772536.516722:0:12032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 6 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.516740:0:12032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 6 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.516755:0:12032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772536.516839:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796590592:12345-192.168.201.34@tcp:101:bash.0 Request processed in 232us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772536.516847:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00080000:0.0:1790772536.516992:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772536.531259:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.531444:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796590720 00000100:00100000:1.0:1790772536.531456:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796590720 00000100:00100000:1.0:1790772536.531520:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:1.0:1790772536.531530:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:11326:x1877760796590720:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772536.531552:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772536.531573:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a5b expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.531617:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.531628:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772536.531633:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772536.531639:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.531679:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.531695:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772536.531712:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba669f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1877760813377280:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772536.531828:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff932885678f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772536.534860:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba669f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1877760813377280:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772536.534941:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.535286:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dac00, rc 0) 00000100:00100000:1.0:1790772536.535367:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:11326:x1877760796590720:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3836us (4122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772536.535377:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1790772536.538626:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.538754:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796590848 00000100:00100000:1.0:1790772536.538766:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796590848 00010000:00010000:1.0:1790772536.538830:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772536.538921:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1790772536.538933:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796590848:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772536.538953:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772536.538980:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.538995:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.539292:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ea4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a54 expref: 7 pid: 12032 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.539317:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772536.539322:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772536.539333:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.539375:0:5841:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.539416:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772536.539432:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba669f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5841:1877760813377408:192.168.201.34@tcp:105: 00000100:00100000:1.0:1790772536.539521:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff932885678f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772536.553434:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba669f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5841:1877760813377408:192.168.201.34@tcp:105: 00010000:00010000:2.0:1790772536.553462:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772536.553527:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796590848:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 14596us (14919us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772536.553539:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1790772536.555729:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.555822:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796591104 00000100:00100000:1.0:1790772536.555833:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796591104 00000100:00100000:1.0:1790772536.555926:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1790772536.555935:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:11326:x1877760796591104:12345-192.168.201.34@tcp:35:bash.0 00000001:00080000:0.0:1790772536.556618:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:0.0:1790772536.556737:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:11326:x1877760796591104:12345-192.168.201.34@tcp:35:bash.0 Request processed in 801us (1015us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790772536.556746:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000020:00080000:0.0:1790772536.556764:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790772536.707739:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.708020:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796591360 00000100:00100000:1.0:1790772536.708031:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796591360 00000100:00100000:0.0:1790772536.708251:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:0.0:1790772536.708263:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:11336:x1877760796591360:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772536.708289:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772536.708310:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772536.708404:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790772536.708525:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a62 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.708539:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:0.0:1790772536.708542:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772536.708547:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a62 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.708561:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772536.708641:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11336:x1877760796591360:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 381us (914us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1790772536.708649:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:3.0:1790772536.718542:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.718619:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796591616 00000100:00100000:0.0:1790772536.718630:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796591616 00000100:00100000:0.0:1790772536.718698:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:0.0:1790772536.718708:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11336:x1877760796591616:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772536.719376:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:11336:x1877760796591616:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 668us (840us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1790772536.719403:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1790772536.838184:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.838348:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796591744 00000100:00100000:1.0:1790772536.838360:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796591744 00000100:00100000:1.0:1790772536.838479:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:1.0:1790772536.838490:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:11342:x1877760796591744:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772536.838516:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772536.838536:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a69 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.838616:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1ec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.838630:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.838667:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772536.838704:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790772536.838708:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772536.838724:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.838750:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a69 expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.838766:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a69 expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.838774:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772536.838777:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772536.838780:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dae00, rc 0) 00000100:00100000:1.0:1790772536.838845:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:11342:x1877760796591744:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 357us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772536.838853:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:2.0:1790772536.852795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.853065:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796592000 00000100:00100000:0.0:1790772536.853078:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796592000 00000100:00100000:0.0:1790772536.853254:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:0.0:1790772536.853267:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:11342:x1877760796592000:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772536.853293:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772536.853320:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a70 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.853427:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.853444:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.853456:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772536.853467:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790772536.853596:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a70 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.853626:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a70 expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.853635:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:0.0:1790772536.853638:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772536.853642:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93800, rc 0) 00000100:00100000:0.0:1790772536.853739:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11342:x1877760796592000:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 475us (956us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790772536.853747:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:2.0:1790772536.864307:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.864769:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796592128 00000100:00100000:0.0:1790772536.864782:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796592128 00000100:00100000:0.0:1790772536.864856:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1790772536.864866:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:2354:x1877760796592128:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772536.864902:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772536.864939:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a70 expref: 24 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.864959:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:0.0:1790772536.864964:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772536.865036:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:2354:x1877760796592128:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 170us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772536.865044:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772536.881386:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.881488:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796592384 00000100:00100000:0.0:1790772536.881499:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796592384 00000100:00100000:0.0:1790772536.881562:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:0.0:1790772536.881572:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:11342:x1877760796592384:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772536.881596:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772536.881630:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a77 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.881741:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.881773:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.881785:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772536.881799:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790772536.881963:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a77 expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.881982:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a77 expref: 25 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.881991:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:0.0:1790772536.881994:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790772536.881997:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772536.882053:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+25:11342:x1877760796592384:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 483us (676us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1790772536.882061:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:2.0:1790772536.891067:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.891175:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796592512 00000100:00100000:1.0:1790772536.891187:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796592512 00000100:00100000:1.0:1790772536.891246:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1790772536.891256:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796592512:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:1.0:1790772536.891303:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.891342:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.891351:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772536.891355:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772536.891360:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.891399:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.891415:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 6 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772536.891430:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813377536:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772536.891530:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff932885678a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772536.894841:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba66b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813377536:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772536.894916:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772536.897019:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.897118:0:6711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796592640 00000100:00100000:1.0:1790772536.897127:0:6711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796592640 00002000:00100000:1.0:1790772536.897176:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff932888283100 x1877760796592640/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:127/0 lens 504/0 e 0 to 0 dl 1790772547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772536.897208:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff932888283100 with x1877760796592640 ext(0->12) 00010000:00010000:1.0:1790772536.897219:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 7 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.897235:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 7 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772536.897243:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff932888283100 00000100:00100000:1.0:1790772536.897282:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1790772536.897292:0:6711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796592640:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:1.0:1790772536.897815:0:6711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2354:x1877760796592640:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 523us (804us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790772536.897822:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:1.0:1790772536.897830:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff932888283100 x1877760796592640/t4294967305(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:127/0 lens 504/448 e 0 to 0 dl 1790772547 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772536.897838:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff932888283100 with x1877760796592640 ext(0->12) 00010000:00010000:1.0:1790772536.897845:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 9 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.897856:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 9 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772536.897863:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff932888283100 00000100:00100000:2.0:1790772536.902261:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.902364:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796592768 00000100:00100000:0.0:1790772536.902376:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796592768 00010000:00010000:0.0:1790772536.902419:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 9 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772536.902463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1790772536.902474:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796592768:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772536.902489:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790772536.902522:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790772536.902525:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790772537 00002000:00010000:0.0:1790772536.902527:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790772537 00002000:00010000:0.0:1790772536.902529:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790772537 00010000:00010000:0.0:1790772536.902536:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 9 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.902549:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 9 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.902571:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d19d49/0xd3c7635991be1eab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a5b expref: 9 pid: 6705 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.902587:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772536.902592:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772536.902597:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.902619:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.902660:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772536.902724:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796592768:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 252us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772536.902731:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00010000:00010000:1.0:1790772536.903424:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903445:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903472:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903482:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903489:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903496:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772536.903500:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903508:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903520:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.903527:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be1ef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772536.903652:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796592512:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 12389us (12586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772536.903661:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1790772536.908571:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.908728:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796593024 00000100:00100000:0.0:1790772536.908739:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796593024 00000100:00100000:0.0:1790772536.909410:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1790772536.909438:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+25:11342:x1877760796593024:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:0.0:1790772536.909504:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a77 expref: 25 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772536.909752:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1790772536.909789:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1790772536.910522:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1790772536.910580:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.910597:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.910620:0:5858:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.911004:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.911022:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 29 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772536.911037:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5858:1877760813377664:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772536.911325:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772536.917554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.917942:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5858:1877760813377664:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772536.917982:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772536.918250:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796593152 00000100:00100000:3.0:1790772536.918258:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796593152 00010000:00010000:3.0:1790772536.918294:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 30 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772536.918335:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1790772536.918344:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+30:2354:x1877760796593152:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772536.918359:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772536.918366:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 30 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.918389:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 30 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.918409:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be1e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a4d expref: 30 pid: 5856 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.918428:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:3.0:1790772536.918433:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.918443:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.918450:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772536.918481:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772536.918544:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:2354:x1877760796593152:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 200us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772536.918552:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00010000:00010000:0.0:1790772536.919472:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772536.919483:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772536.919627:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1790772536.919840:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1790772536.920529:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813377792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790772536.920633:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772536.920724:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772536.927937:0:5861:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813377792 00000100:00100000:3.0:1790772536.927955:0:5861:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813377792 00000100:00100000:3.0:1790772536.928266:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772536.928279:0:5861:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1877760813377792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790772536.928418:0:5861:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1877760813377792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (7785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772536.928426:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772536.928546:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813377792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772536.929216:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1790772536.929300:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1196680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813377920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790772536.929350:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772536.929377:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328883db600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772536.929685:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813377920 00000100:00100000:1.0:1790772536.929692:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813377920 00000100:00100000:1.0:1790772536.929721:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772536.929728:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1877760813377920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790772536.929922:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1877760813377920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 186us (563us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790772536.929930:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790772536.930124:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772536.930361:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1196680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813377920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772536.930417:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1790772536.930454:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772536.930465:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772536.930473:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772536.930479:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772536.930483:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772536.930491:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772536.930506:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:2.0:1790772536.930517:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790772536.930522:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772536.930529:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1eff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772536.930726:0:5858:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790772536.930818:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1790772536.930828:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357750952075ns, next at 358750950180ns, rc = 0 00000001:00080000:2.0:1790772536.930833:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1790772536.930863:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff932884f65200) 00010000:00010000:2.0:1790772536.930866:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790772536.930905:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be1eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a77 expref: 33 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772536.931455:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11342:x1877760796593024:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 22019us (22891us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1790772536.931463:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000020:00080000:2.0:1790772536.931468:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790772536.934690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772536.934775:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796593280 00000100:00100000:1.0:1790772536.934785:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796593280 00000100:00100000:1.0:1790772536.934846:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:1.0:1790772536.934855:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11342:x1877760796593280:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772536.934922:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772536.934945:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a7e expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.935120:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a7e expref: 33 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.935136:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a7e expref: 33 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772536.935155:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772536.935172:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772536.935177:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772536.935238:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:11342:x1877760796593280:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 383us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772536.935245:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:3.0:1790772536.939711:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772536.940195:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796593536 00000100:00100000:0.0:1790772536.940207:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796593536 00000100:00100000:0.0:1790772536.940263:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1790772536.940273:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+33:11342:x1877760796593536:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772536.940501:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:11342:x1877760796593536:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 228us (801us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1790772536.940509:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1790772537.048045:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.048162:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796593792 00000100:00100000:0.0:1790772537.048174:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796593792 00000100:00100000:0.0:1790772537.048236:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:0.0:1790772537.048246:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:11352:x1877760796593792:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772537.048273:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772537.048296:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a85 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772537.048410:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790772537.048531:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a85 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.048547:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:0.0:1790772537.048551:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772537.048556:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a85 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.048571:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92c00, rc 0) 00000100:00100000:0.0:1790772537.048652:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:11352:x1877760796593792:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 407us (618us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1790772537.048660:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:1.0:1790772537.055784:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.058568:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796593920 00000100:00100000:0.0:1790772537.058593:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796593920 00000100:00100000:0.0:1790772537.058709:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:0.0:1790772537.058722:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:11352:x1877760796593920:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1790772537.058844:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.058899:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.058915:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.058935:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.058964:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.058972:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059095:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059104:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059111:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772537.059164:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059180:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059187:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059195:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059201:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772537.059206:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059214:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059234:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772537.059237:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772537.059243:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059250:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059279:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059286:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059292:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059297:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772537.059301:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059308:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059316:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328829d4c00) 00010000:00010000:0.0:1790772537.059318:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772537.059321:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059327:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059355:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059361:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059367:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059372:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772537.059375:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059381:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059388:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772537.059391:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772537.059394:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.059399:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772537.059638:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:11352:x1877760796593920:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 916us (3869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772537.059648:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:3.0:1790772537.062527:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.062654:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796594176 00000100:00100000:0.0:1790772537.062668:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796594176 00000100:00100000:0.0:1790772537.062738:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1790772537.062772:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:11352:x1877760796594176:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772537.063136:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:11352:x1877760796594176:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 365us (623us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790772537.063144:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00010000:00010000:1.0:1790772537.103855:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772537.166609:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.166774:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796594432 00000100:00100000:0.0:1790772537.166792:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796594432 00000100:00100000:0.0:1790772537.167690:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:0.0:1790772537.167705:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:11355:x1877760796594432:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772537.167744:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772537.167773:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a8c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.167915:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.167934:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.167949:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.167965:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.167972:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.167978:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168160:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168170:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168176:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772537.168188:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790772537.168333:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168341:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168347:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168353:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772537.168359:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168368:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168381:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772537.168384:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772537.168391:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168421:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168438:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168445:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168452:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168457:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772537.168460:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168466:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168473:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328829d4c00) 00010000:00010000:0.0:1790772537.168476:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772537.168478:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168484:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be1f3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168537:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be1f30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168554:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.168569:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772537.168572:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772537.168575:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93600, rc 0) 00000100:00100000:0.0:1790772537.168685:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11355:x1877760796594432:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 982us (2098us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1790772537.168693:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:3.0:1790772537.177828:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772537.178034:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796594560 00000100:00100000:2.0:1790772537.178048:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796594560 00000100:00100000:2.0:1790772537.178123:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:2.0:1790772537.178134:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11355:x1877760796594560:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1790772537.178237:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178400:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178414:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178450:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178459:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178467:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178473:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772537.178478:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178487:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178501:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772537.178505:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772537.178511:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.178517:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1f53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772537.178696:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11355:x1877760796594560:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 562us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772537.178715:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:2.0:1790772537.181233:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.181398:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796594816 00000100:00100000:0.0:1790772537.181411:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796594816 00000100:00100000:0.0:1790772537.181472:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:0.0:1790772537.181482:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11355:x1877760796594816:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772537.201468:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:11355:x1877760796594816:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 19970us (20233us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790772537.201487:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1790772537.530030:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772537.530222:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796595072 00000100:00100000:1.0:1790772537.530238:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796595072 00000100:00100000:1.0:1790772537.530316:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:1.0:1790772537.530328:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:11386:x1877760796595072:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:1.0:1790772537.530373:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772537.530402:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a93 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.530536:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.530554:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.530571:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772537.530585:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790772537.530765:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a93 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.530787:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a93 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.530821:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772537.530825:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772537.530829:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dac00, rc 0) 00000100:00100000:1.0:1790772537.530980:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:11386:x1877760796595072:12345-192.168.201.34@tcp:101:cat.0 Request processed in 654us (976us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1790772537.530989:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:1.0:1790772537.536510:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772537.536553:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.536626:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796595200 00000100:00100000:0.0:1790772537.536646:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796595200 00000100:00100000:0.0:1790772537.536744:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1790772537.536760:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:2355:x1877760796595200:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772537.536782:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772537.536815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be1f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a93 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.536841:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772537.536847:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772537.536975:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:2355:x1877760796595200:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 219us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772537.536984:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1790772537.537295:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796595456 00000100:00100000:2.0:1790772537.537302:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796595456 00000100:00100000:2.0:1790772537.537347:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1790772537.537365:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:11386:x1877760796595456:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:2.0:1790772537.537846:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:11386:x1877760796595456:12345-192.168.201.34@tcp:35:cat.0 Request processed in 480us (1290us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790772537.537854:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:0.0:1790772537.547491:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772537.547525:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813378048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772537.547656:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772537.547838:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813378048 00000100:00100000:3.0:1790772537.547850:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813378048 00000100:00100000:3.0:1790772537.547948:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790772537.547959:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813378048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772537.547992:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772537.548054:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813378048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772537.548062:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790772537.548372:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813378048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772537.609598:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772537.609754:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796595712 00000100:00100000:0.0:1790772537.609763:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796595712 00000100:00100000:0.0:1790772537.609828:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:0.0:1790772537.609839:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:11392:x1877760796595712:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1790772537.609869:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772537.609872:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772537.610084:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1ec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a69 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.610191:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772537.610196:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772537.610209:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50a9a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.610288:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.610299:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.610306:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.610331:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772537.610340:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 41 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772537.610368:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813378176:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772537.610543:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288391e480 going to sleep for 11 seconds 00000040:00080000:2.0:1790772537.617084:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772537.617092:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772537.617609:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1790772537.617616:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772537.628238:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772537.628363:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796595840 00000100:00100000:3.0:1790772537.628373:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796595840 00010000:00010000:3.0:1790772537.628412:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 42 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772537.628452:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1790772537.628461:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:2355:x1877760796595840:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772537.628476:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772537.628483:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 42 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.628497:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 42 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.628536:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772537.628541:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.628551:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.628559:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772537.628576:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772537.628648:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:2355:x1877760796595840:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 187us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772537.628656:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00010000:00010000:2.0:1790772537.628816:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be1f45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a8c expref: 41 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772537.628833:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813378176:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772537.628855:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.628865:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.628871:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772537.628939:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790772537.629359:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be1f6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 42 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.629377:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772537.629386:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772537.629389:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772537.629391:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:2.0:1790772537.629426:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:11392:x1877760796595712:12345-192.168.201.34@tcp:101:dd.0 Request processed in 19590us (19847us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1790772537.629432:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:0.0:1790772537.633744:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772537.633921:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796596096 00000100:00100000:1.0:1790772537.633932:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796596096 00000100:00100000:1.0:1790772537.634001:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:1.0:1790772537.634012:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+41:11392:x1877760796596096:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:1.0:1790772537.634311:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.634329:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.634341:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772537.634398:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1790772537.634423:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001a58fb17 reply state 000000007794b98d transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772537.634433:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772537.634544:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:11392:x1877760796596096:12345-192.168.201.34@tcp:36:dd.0 Request processed in 534us (811us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1790772537.634551:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000020:00080000:1.0:1790772537.634557:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772537.655329:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.655353:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.655362:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.655369:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772537.655375:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.655384:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.655402:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772537.655406:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772537.655411:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772537.655417:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1f84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772538.106498:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772538.106777:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796596224 00000100:00100000:3.0:1790772538.106791:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796596224 00000100:00100000:3.0:1790772538.106904:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:3.0:1790772538.106924:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+43:11406:x1877760796596224:12345-192.168.201.34@tcp:101:stat.0 00000100:00080000:0.0:1790772538.107078:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772538.107165:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772538.107188:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1f8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50aa1 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107253:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107269:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107280:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107310:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107318:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107326:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107409:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107422:0:8380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107431:0:8380:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107466:0:8380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.107479:0:8380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 44 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772538.107493:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e48700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813378304:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772538.107896:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9886b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772538.111805:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772538.111976:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e48700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813378304:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772538.112006:0:8380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772538.113240:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796596480 00000100:00100000:0.0:1790772538.113253:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796596480 00000100:00100000:0.0:1790772538.113325:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1790772538.113337:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:5593:x1877760796596480:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790772538.113826:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:5593:x1877760796596480:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 489us (2030us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1790772538.113835:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1790772538.117226:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772538.118550:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796596608 00000100:00100000:2.0:1790772538.118565:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796596608 00010000:00010000:2.0:1790772538.118677:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 46 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772538.118784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1790772538.118794:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:2354:x1877760796596608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772538.118811:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772538.118818:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 46 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.118832:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 46 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.118892:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1f76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a9a expref: 46 pid: 5855 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.118911:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772538.118928:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.118937:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.119050:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.119082:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772538.119193:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:2354:x1877760796596608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 400us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772538.119201:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00010000:00010000:1.0:1790772538.119270:0:8380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119280:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772538.119321:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790772538.119326:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772538.119350:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119361:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119371:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119377:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119384:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119390:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772538.119394:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119403:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119412:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772538.119423:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772538.119428:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119434:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be1f92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119447:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119453:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119460:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119465:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772538.119469:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119475:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119483:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff932884f65900) 00010000:00010000:1.0:1790772538.119486:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772538.119488:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119494:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be1f99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119535:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1f8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa1 expref: 45 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119562:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa1 expref: 44 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.119570:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772538.119573:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772538.119575:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8200, rc 0) 00000100:00100000:1.0:1790772538.119614:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:11406:x1877760796596224:12345-192.168.201.34@tcp:101:stat.0 Request processed in 12701us (13124us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772538.119622:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 155 00010000:00010000:0.0:1790772538.128577:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772538.222249:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772538.222522:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796596864 00000100:00100000:3.0:1790772538.222532:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796596864 00000100:00100000:3.0:1790772538.222663:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:3.0:1790772538.222673:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:11412:x1877760796596864:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:3.0:1790772538.222738:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772538.222768:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa1 expref: 44 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.222792:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772538.222798:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772538.224018:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.224039:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.224050:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772538.224121:0:5856:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1790772538.224146:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007b6d7997 reply state 0000000030f6fc2b transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772538.224156:0:5856:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772538.224328:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:11412:x1877760796596864:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 1653us (2095us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1790772538.224338:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 156 00000020:00080000:3.0:1790772538.224344:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772538.231022:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.231039:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.231045:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.231051:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772538.231056:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.231083:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.231115:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772538.231118:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772538.231123:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.231128:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772538.524786:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772538.530844:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796596992 00000100:00100000:2.0:1790772538.530860:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796596992 00000100:00100000:3.0:1790772538.536849:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:3.0:1790772538.536867:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+45:11426:x1877760796596992:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:3.0:1790772538.536915:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772538.537220:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50aa8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537301:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537316:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537327:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537341:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537347:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537354:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537447:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537456:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537463:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772538.537499:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790772538.537504:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772538.537526:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537545:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537553:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537560:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537566:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537582:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772538.537586:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537594:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.537605:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772538.537607:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772538.537611:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538098:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be1fb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538123:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538129:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538144:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538150:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772538.538153:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538160:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538168:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff932884f65300) 00010000:00010000:3.0:1790772538.538171:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772538.538173:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538178:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be1fbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538220:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be1fae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 47 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538705:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 46 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.538714:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772538.538717:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772538.538720:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8c00, rc 0) 00000100:00100000:3.0:1790772538.538846:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:11426:x1877760796596992:12345-192.168.201.34@tcp:101:stat.0 Request processed in 1985us (14071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772538.538865:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:3.0:1790772538.778794:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772538.779224:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796597248 00000100:00100000:2.0:1790772538.779239:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796597248 00000100:00100000:2.0:1790772538.779310:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:2.0:1790772538.779323:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+46:11436:x1877760796597248:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772538.779353:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772538.779380:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1fca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50aaf expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772538.779483:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790772538.779785:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1fca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aaf expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.779801:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:2.0:1790772538.779805:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772538.779811:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be1fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aaf expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.779827:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518800, rc 0) 00000100:00100000:2.0:1790772538.780093:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:11436:x1877760796597248:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 771us (1310us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1790772538.780101:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:0.0:1790772538.785580:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772538.785779:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796597504 00000100:00100000:2.0:1790772538.785790:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796597504 00000100:00100000:2.0:1790772538.785859:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1790772538.785905:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+47:11436:x1877760796597504:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1790772538.786404:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:11436:x1877760796597504:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 535us (841us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1790772538.786412:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1790772538.932767:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772538.932914:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796597760 00000100:00100000:1.0:1790772538.932926:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796597760 00000100:00100000:1.0:1790772538.933006:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:1.0:1790772538.933017:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:11442:x1877760796597760:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772538.933046:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772538.933071:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1fd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ab6 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.933193:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.933207:0:8380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.933215:0:8380:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.933266:0:8380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.933280:0:8380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 49 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772538.933293:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba669880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813378432:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772538.933394:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff932885678a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772538.938134:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba669880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813378432:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772538.938168:0:8380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772538.938950:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772538.939718:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796597888 00000100:00100000:3.0:1790772538.939732:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796597888 00010000:00010000:3.0:1790772538.939782:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 50 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772538.939825:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1790772538.939837:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:2355:x1877760796597888:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772538.939852:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772538.939859:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 50 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.939905:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 50 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.939926:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be1fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aa8 expref: 50 pid: 5855 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.939948:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772538.939954:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.939963:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.939971:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772538.940018:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772538.940085:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:2355:x1877760796597888:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 250us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772538.940092:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:1.0:1790772538.940166:0:8380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.940174:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772538.940193:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790772538.940332:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be1fd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 50 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.940347:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 49 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.940354:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772538.940357:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772538.940366:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dae00, rc 0) 00000100:00100000:1.0:1790772538.940394:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:11442:x1877760796597760:12345-192.168.201.34@tcp:101:bash.0 Request processed in 7380us (7639us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1790772538.940401:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:3.0:1790772538.950665:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772538.950814:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796598144 00000100:00100000:2.0:1790772538.950825:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796598144 00000100:00100000:2.0:1790772538.950952:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:2.0:1790772538.950964:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+49:11442:x1877760796598144:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1790772538.951232:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.951250:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772538.951276:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772538.951328:0:5857:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1790772538.951351:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001c529b6b reply state 00000000208c7c6d transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772538.951360:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772538.951456:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11442:x1877760796598144:12345-192.168.201.34@tcp:36:bash.0 Request processed in 495us (800us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1790772538.951464:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 160 00000020:00080000:2.0:1790772538.951469:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772538.955655:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.955674:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.955682:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.955688:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772538.955693:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.955701:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.955717:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772538.955736:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772538.955742:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.955748:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be1fed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772538.967032:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772538.967113:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796598272 00000100:00100000:0.0:1790772538.967123:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796598272 00000100:00100000:0.0:1790772538.967171:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:0.0:1790772538.967178:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:11442:x1877760796598272:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772538.967198:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772538.967214:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50abd expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.967294:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.967310:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 52 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.967318:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.967354:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 52 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.967368:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 52 pid: 8380 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772538.967400:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1194380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813378560:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772538.967496:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288391e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772538.971733:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772538.971815:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796598400 00000100:00100000:1.0:1790772538.971826:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796598400 00010000:00010000:1.0:1790772538.971907:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 53 pid: 8380 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772538.971938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1790772538.971948:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:2354:x1877760796598400:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772538.971964:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772538.971971:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 53 pid: 8380 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.971985:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 53 pid: 8380 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.972007:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772538.972013:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.972023:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.972031:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772538.972049:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772538.972110:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:2354:x1877760796598400:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 164us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772538.972116:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00010000:00010000:0.0:1790772538.972656:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be1fdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ab6 expref: 52 pid: 8380 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772538.972673:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1194380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813378560:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772538.972693:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.972701:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.972707:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772538.972752:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790772538.972757:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772538.972779:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.972810:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be1ff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50abd expref: 52 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.972823:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50abd expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772538.972831:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772538.972842:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772538.972845:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:0.0:1790772538.972940:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:11442:x1877760796598272:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5760us (5914us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772538.972947:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:2.0:1790772538.976795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772538.976909:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796598656 00000100:00100000:3.0:1790772538.976921:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796598656 00000100:00100000:3.0:1790772538.976981:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1790772538.976992:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:11442:x1877760796598656:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1790772538.977222:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11442:x1877760796598656:12345-192.168.201.34@tcp:35:bash.0 Request processed in 233us (436us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1790772538.977228:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1790772539.083292:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813378816:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083365:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.083430:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813379328:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083456:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.083487:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772539.083493:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813378688:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083519:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.083540:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813379200:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083581:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.083608:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813378688 00000100:00100000:0.0:1790772539.083616:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813378688 00000100:00100000:0.0:1790772539.083666:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790772539.083675:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813378688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083725:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813378688:12345-0@lo:400:kworker.0 Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.083733:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790772539.083777:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813379328 00000100:00100000:0.0:1790772539.083780:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813379328 00000100:00100000:1.0:1790772539.083784:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813379072:0@lo:400:kworker.0 00000100:00100000:1.0:1790772539.083813:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.083814:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790772539.083821:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813379328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772539.083835:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772539.083841:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff932888346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813378944:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083851:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813379328:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.083860:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.083902:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790772539.083912:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813379072 00000100:00100000:0.0:1790772539.083915:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813379072 00000100:00100000:0.0:1790772539.083939:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790772539.083946:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813379072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.083981:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813379072:12345-0@lo:400:kworker.0 Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.083987:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1790772539.084002:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772539.084005:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772539.084030:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813378688:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.084044:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813379328:0@lo:400:kworker.0 00000100:00100000:3.0:1790772539.084152:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813378816 00000100:00100000:3.0:1790772539.084157:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813378816 00000100:00100000:0.0:1790772539.088158:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813379200 00000100:00100000:0.0:1790772539.088176:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813379200 00000100:00100000:3.0:1790772539.090034:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813378944 00000100:00100000:3.0:1790772539.090048:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813378944 00000100:00100000:1.0:1790772539.092540:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813379072:0@lo:400:kworker.0 00000100:00080000:1.0:1790772539.092643:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772539.092676:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790772539.092692:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772539.092787:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813378816:12345-0@lo:400:kworker.0 Request processed in 102us (9422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.092795:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790772539.092821:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790772539.092829:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813379200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772539.092866:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813379200:12345-0@lo:400:kworker.0 Request processed in 39us (9284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.092872:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790772539.092909:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790772539.092926:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813378944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772539.093119:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813378944:12345-0@lo:400:kworker.0 Request processed in 204us (9257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.093125:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790772539.093170:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813378944:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.093373:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813379200:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.093386:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff932888345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813378816:0@lo:400:kworker.0 00000100:00100000:0.0:1790772539.095182:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.095305:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796598912 00000100:00100000:1.0:1790772539.095317:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796598912 00000100:00100000:1.0:1790772539.095424:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:1.0:1790772539.095433:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11452:x1877760796598912:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772539.095456:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772539.095475:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ac4 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772539.095578:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790772539.095719:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2002 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ac4 expref: 54 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.095734:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:1.0:1790772539.095737:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772539.095742:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ac4 expref: 54 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.095755:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db000, rc 0) 00000100:00100000:1.0:1790772539.095824:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:11452:x1877760796598912:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 391us (649us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1790772539.095832:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:2.0:1790772539.100150:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.100285:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796599040 00000100:00100000:1.0:1790772539.100295:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796599040 00000100:00100000:1.0:1790772539.100347:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:1.0:1790772539.100356:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:11452:x1877760796599040:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:1.0:1790772539.100434:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100464:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100475:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100490:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100498:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100504:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100600:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100711:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100720:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772539.100764:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100776:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100781:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100802:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100808:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.100813:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100821:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100833:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772539.100836:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772539.100841:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100847:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100861:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100866:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.100925:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101011:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.101015:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101030:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101038:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328a16c3e00) 00010000:00010000:1.0:1790772539.101041:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772539.101044:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101049:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101065:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101071:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101077:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101081:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.101083:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101088:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101094:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772539.101096:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772539.101098:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.101112:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be201e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.101188:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:11452:x1877760796599040:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 831us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.101196:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:2.0:1790772539.103773:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.104119:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796599296 00000100:00100000:3.0:1790772539.104129:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796599296 00000100:00100000:3.0:1790772539.104250:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1790772539.104261:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+53:11452:x1877760796599296:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772539.104497:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:11452:x1877760796599296:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 238us (735us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1790772539.104504:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00010000:00010000:0.0:1790772539.147865:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772539.170306:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.170408:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796599552 00000100:00100000:3.0:1790772539.170419:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796599552 00000100:00100000:3.0:1790772539.170484:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:3.0:1790772539.170500:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:11455:x1877760796599552:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772539.170524:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.170551:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be2025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50acb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171248:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171267:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171278:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171293:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171299:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171307:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171417:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be203a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171427:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be203a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.171434:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be203a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772539.171455:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790772539.172139:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172150:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172156:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172162:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772539.172166:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172173:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172186:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772539.172189:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772539.172194:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172201:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be202c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172218:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172224:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172241:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172245:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772539.172248:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172253:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172259:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff932884f65300) 00010000:00010000:3.0:1790772539.172261:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772539.172264:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172269:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172317:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be2025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50acb expref: 57 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172332:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be203a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50acb expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.172340:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772539.172342:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772539.172344:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9600, rc 0) 00000100:00100000:3.0:1790772539.172479:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:11455:x1877760796599552:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1986us (2181us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790772539.172509:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:0.0:1790772539.181450:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.181505:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.181589:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796599808 00000100:00100000:1.0:1790772539.181600:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796599808 00000100:00100000:1.0:1790772539.181663:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1790772539.181674:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:2355:x1877760796599808:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772539.181694:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772539.181720:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be203a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50acb expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.181739:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772539.181743:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772539.181795:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:2355:x1877760796599808:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.181803:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1790772539.181862:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796599680 00000100:00100000:3.0:1790772539.181868:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796599680 00000100:00100000:3.0:1790772539.181938:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:3.0:1790772539.181945:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11455:x1877760796599680:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1790772539.182000:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182014:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182024:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182048:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182056:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182062:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182068:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772539.182072:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182079:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182087:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772539.182102:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772539.182108:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.182114:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.182149:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11455:x1877760796599680:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 204us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.182156:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:2.0:1790772539.186274:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.186351:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796600064 00000100:00100000:1.0:1790772539.186362:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796600064 00000100:00100000:1.0:1790772539.186421:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1790772539.186432:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11455:x1877760796600064:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772539.186709:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:11455:x1877760796600064:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 278us (444us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1790772539.186735:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:0.0:1790772539.376293:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.376734:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796600320 00000100:00100000:1.0:1790772539.376745:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796600320 00000100:00100000:1.0:1790772539.376807:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:1.0:1790772539.376818:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:11473:x1877760796600320:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:1.0:1790772539.376842:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772539.376863:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be204f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ad2 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.377004:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be2056 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.377018:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be2056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.377028:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be2056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772539.377039:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790772539.377162:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be204f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ad2 expref: 59 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.377181:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be2056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ad2 expref: 58 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.377190:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772539.377193:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772539.377196:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030800, rc 0) 00000100:00100000:1.0:1790772539.377330:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11473:x1877760796600320:12345-192.168.201.34@tcp:101:cat.0 Request processed in 513us (1044us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790772539.377338:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:2.0:1790772539.407409:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.407531:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796600448 00000100:00100000:3.0:1790772539.407542:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796600448 00000100:00100000:3.0:1790772539.407619:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:3.0:1790772539.407629:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11474:x1877760796600448:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772539.407656:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.407677:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ad9 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.407747:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be206b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.407762:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be206b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.407787:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be206b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772539.407826:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790772539.407830:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772539.407849:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be206b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.407950:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ad9 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.407968:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be206b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ad9 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.407977:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772539.407980:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772539.407983:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8600, rc 0) 00000100:00100000:3.0:1790772539.408056:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11474:x1877760796600448:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 428us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.408062:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:2.0:1790772539.419460:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.419564:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796600832 00000100:00100000:1.0:1790772539.419575:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796600832 00000100:00100000:1.0:1790772539.419646:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:1.0:1790772539.419656:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11474:x1877760796600832:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772539.420033:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11474:x1877760796600832:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 376us (582us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1790772539.420041:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1790772539.428183:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.428467:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796600960 00000100:00100000:1.0:1790772539.428478:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796600960 00000100:00100000:1.0:1790772539.428550:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772539.428571:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11474:x1877760796600960:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:1.0:1790772539.428589:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790772539.428626:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be1ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50abd expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.428649:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be2056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ad2 expref: 59 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.428662:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be1f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a7e expref: 58 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.428671:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772539.428683:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772539.428766:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11474:x1877760796600960:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 206us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.428774:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1790772539.432332:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.432413:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601088 00000100:00100000:1.0:1790772539.432424:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601088 00000100:00100000:1.0:1790772539.432485:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:1.0:1790772539.432494:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11474:x1877760796601088:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:1.0:1790772539.432702:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.432718:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.432729:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772539.433468:0:8380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790772539.433554:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11474:x1877760796601088:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1060us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.433574:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:0.0:1790772539.467781:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.468096:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601216 00000100:00100000:3.0:1790772539.468108:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601216 00000100:00100000:3.0:1790772539.468170:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:3.0:1790772539.468181:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11476:x1877760796601216:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772539.468203:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.468226:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ae0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468292:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468307:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468318:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468347:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468355:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468361:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468445:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468455:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468463:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772539.468500:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790772539.468504:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772539.468524:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468534:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468542:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468549:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468580:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468586:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772539.468590:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468598:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468685:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772539.468690:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772539.468695:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468702:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468722:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468730:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468736:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468741:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772539.468744:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468761:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468769:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff932884f65300) 00010000:00010000:3.0:1790772539.468771:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772539.468774:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468779:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8400/0xd3c7635991be2087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468814:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be2079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468829:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.468836:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:3.0:1790772539.468838:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772539.468841:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9400, rc 0) 00000100:00100000:3.0:1790772539.469323:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11476:x1877760796601216:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1142us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.469332:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:0.0:1790772539.514794:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.514856:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.514947:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.514979:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.515010:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601728 00000100:00100000:0.0:1790772539.515020:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601728 00000100:00100000:0.0:1790772539.515076:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:0.0:1790772539.515086:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796601728:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772539.515164:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796601728:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.515172:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:2.0:1790772539.515378:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601600 00000100:00100000:2.0:1790772539.515383:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601600 00000100:00100000:2.0:1790772539.515424:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601472 00000100:00100000:2.0:1790772539.515427:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601472 00000100:00100000:2.0:1790772539.515454:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1790772539.515462:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796601600:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772539.515500:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796601600:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.515518:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1790772539.515531:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:2.0:1790772539.515538:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796601472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772539.515575:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796601472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.515581:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:1.0:1790772539.515940:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601344 00000100:00100000:1.0:1790772539.515945:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601344 00000100:00100000:1.0:1790772539.515983:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 299 00000100:00100000:1.0:1790772539.515990:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796601344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772539.516027:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2355:x1877760796601344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.516033:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 299 00000100:00080000:1.0:1790772539.516058:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772539.516070:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772539.516072:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772539.600010:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772539.600034:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba66aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813379456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772539.600107:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.600239:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813379456 00000100:00100000:2.0:1790772539.600248:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813379456 00000100:00100000:2.0:1790772539.600304:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772539.600314:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813379456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772539.600351:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772539.600401:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813379456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.600409:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772539.600453:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba66aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813379456:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790772539.654415:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1790772539.654429:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:2.0:1790772539.659083:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772539.659092:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772539.659141:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790772539.659148:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772539.659266:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc04000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813379584:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772539.659354:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772539.668216:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772539.668256:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601856 00000100:00100000:2.0:1790772539.668266:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601856 00000100:00100000:2.0:1790772539.668330:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:2.0:1790772539.668351:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796601856:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772539.668389:0:5856:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772539.668497:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796601856:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 148us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.668505:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:1.0:1790772539.670242:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc04000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813379584:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772539.672359:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772539.672587:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796601984 00000100:00100000:2.0:1790772539.672597:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796601984 00000100:00100000:2.0:1790772539.672848:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:2.0:1790772539.672859:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11487:x1877760796601984:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790772539.673214:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673233:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673246:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673262:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673270:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673277:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673304:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673329:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673337:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772539.673379:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790772539.673383:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772539.673396:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673407:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673413:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673419:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673425:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772539.673430:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673439:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673450:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:2.0:1790772539.673454:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772539.673458:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673476:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be2095 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673490:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673496:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673502:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673508:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772539.673511:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673517:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.673523:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9328a1803f00) 00010000:00010000:2.0:1790772539.673526:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772539.673528:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674847:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be209c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674884:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674891:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674905:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674910:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772539.674914:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674930:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674943:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:2.0:1790772539.674946:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772539.674949:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.674954:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be20a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.675054:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11487:x1877760796601984:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 2193us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.675065:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:2.0:1790772539.690816:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.693156:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796602240 00000100:00100000:1.0:1790772539.693172:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796602240 00000100:00100000:1.0:1790772539.693236:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:1.0:1790772539.693246:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11487:x1877760796602240:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.693267:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772539.693286:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be20aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ae7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.693390:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.693404:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.693416:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772539.693427:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790772539.696683:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696703:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696723:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696730:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880031e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.696734:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696809:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696828:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:1.0:1790772539.696831:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772539.696836:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696843:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be20b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696924:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be20aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae7 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696936:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:1.0:1790772539.696938:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772539.696942:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be20aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae7 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.696952:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030800, rc 0) 00000100:00100000:1.0:1790772539.697030:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796602240:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3784us (6219us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1790772539.697047:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:2.0:1790772539.709442:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.709483:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796602368 00000100:00100000:3.0:1790772539.709494:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796602368 00000100:00100000:3.0:1790772539.709572:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:3.0:1790772539.709582:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796602368:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772539.709643:0:8380:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790772539.709744:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796602368:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 163us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.709752:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:1.0:1790772539.718085:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.718148:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796602624 00000100:00100000:3.0:1790772539.718159:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796602624 00000100:00100000:3.0:1790772539.718215:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:3.0:1790772539.718225:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796602624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772539.718246:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.718250:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790772539.718275:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be206b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ad9 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.718295:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772539.718300:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772539.718312:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be20bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50aee expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790772539.718765:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790772539.718981:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be20c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.718996:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be20c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.719006:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be20c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.719076:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be20bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aee expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.719094:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be20c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aee expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.719101:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65300) 00010000:00010000:3.0:1790772539.719104:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772539.719107:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8a00, rc 0) 00000100:00100000:3.0:1790772539.719175:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11487:x1877760796602624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 951us (1441us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1790772539.719184:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:3.0:1790772539.732512:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.732589:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796602880 00000100:00100000:1.0:1790772539.732600:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796602880 00000100:00100000:1.0:1790772539.732659:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:1.0:1790772539.732669:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11487:x1877760796602880:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.732729:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772539.732758:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8a00/0xd3c7635991be20c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50aee expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732780:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65300) 00010000:00010000:1.0:1790772539.732792:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772539.732819:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732834:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732843:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732860:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732868:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732910:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.732999:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733007:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733013:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733020:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.733024:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733031:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733040:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772539.733043:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772539.733047:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733053:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be20d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733063:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733068:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733074:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733084:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.733087:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733092:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733100:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9bfddb6f (ffff9328a16c3800) 00010000:00010000:1.0:1790772539.733102:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772539.733105:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.733110:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9bfddb6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.733191:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796602880:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 522us (687us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772539.733199:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:1.0:1790772539.738047:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.738151:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796603008 00000100:00100000:3.0:1790772539.738163:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796603008 00000100:00100000:3.0:1790772539.738217:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:3.0:1790772539.738228:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11487:x1877760796603008:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772539.738251:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.738276:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be20e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50af5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.738313:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.738326:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.738355:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.738447:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8600/0xd3c7635991be20e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.738465:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.738474:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:3.0:1790772539.738477:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790772539.738480:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8e00, rc 0) 00000100:00100000:3.0:1790772539.738545:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11487:x1877760796603008:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 320us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.738561:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:3.0:1790772539.742451:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.742517:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796603264 00000100:00100000:1.0:1790772539.742529:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796603264 00000100:00100000:1.0:1790772539.742592:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:1.0:1790772539.742607:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11487:x1877760796603264:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.742694:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.742712:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.742742:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772539.743202:0:8380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1790772539.743214:0:8380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360563337913ns, next at 361563334966ns, rc = 0 00000004:00010000:1.0:1790772539.743301:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000067a29866 reply state 00000000b639ef2a transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.743312:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772539.743428:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11487:x1877760796603264:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 825us (984us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1790772539.743437:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00010000:00010000:0.0:1790772539.746386:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.746407:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.746415:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.746421:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772539.746426:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.746434:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.746451:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:0.0:1790772539.746454:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772539.746473:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.746480:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be20f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.747680:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.747756:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796603392 00000100:00100000:0.0:1790772539.747768:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796603392 00000100:00100000:0.0:1790772539.747828:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:0.0:1790772539.747839:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11487:x1877760796603392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772539.747864:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772539.747924:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50afc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.747988:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.748001:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.748021:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:0.0:1790772539.748025:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772539.748028:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:0.0:1790772539.748086:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11487:x1877760796603392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 250us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.748093:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:3.0:1790772539.759213:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.759285:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796603520 00000100:00100000:0.0:1790772539.759296:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796603520 00000100:00100000:0.0:1790772539.759351:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1790772539.759373:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796603520:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790772539.759703:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796603520:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 330us (498us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1790772539.759710:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1790772539.764413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.764959:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796603776 00000100:00100000:1.0:1790772539.764972:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796603776 00000100:00100000:1.0:1790772539.765027:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1790772539.765038:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11487:x1877760796603776:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772539.765312:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+63:11487:x1877760796603776:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 274us (909us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790772539.765321:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1790772539.784408:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.784497:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604032 00000100:00100000:1.0:1790772539.784507:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604032 00000100:00100000:1.0:1790772539.784569:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:1.0:1790772539.784581:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+63:11487:x1877760796604032:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772539.784711:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+63:11487:x1877760796604032:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 131us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.784735:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:0.0:1790772539.794750:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.794856:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604160 00000100:00100000:1.0:1790772539.794867:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604160 00000100:00100000:1.0:1790772539.794946:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:1.0:1790772539.794955:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+63:11487:x1877760796604160:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.794978:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772539.794998:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b03 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.795083:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.795098:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.795109:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772539.795145:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772539.795164:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.795190:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be20fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b03 expref: 65 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.795206:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b03 expref: 64 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.795215:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:1.0:1790772539.795225:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790772539.795229:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772539.795294:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11487:x1877760796604160:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 339us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.795301:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:3.0:1790772539.804589:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.804648:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604288 00000100:00100000:3.0:1790772539.804658:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604288 00000100:00100000:3.0:1790772539.804708:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1790772539.804717:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796604288:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772539.804736:0:12032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772539.804756:0:12032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b0a expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772539.804793:0:12032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd053c, blocks: 0x1 00010000:00010000:3.0:1790772539.804812:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1790772539.804816:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772539.804826:0:12032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 8 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.804846:0:12032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 8 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.804860:0:12032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8c00, rc 0) 00000100:00100000:3.0:1790772539.805136:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796604288:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 418us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.805143:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1790772539.812810:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.813024:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604544 00000100:00100000:1.0:1790772539.813035:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604544 00000100:00100000:1.0:1790772539.813149:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:1.0:1790772539.813161:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11487:x1877760796604544:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772539.813282:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11487:x1877760796604544:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 123us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.813290:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:0.0:1790772539.816983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772539.817085:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604672 00000100:00100000:2.0:1790772539.817095:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604672 00000100:00100000:2.0:1790772539.817143:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1790772539.817153:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:11487:x1877760796604672:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772539.817172:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772539.817205:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b11 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.817239:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 9 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.817247:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772539.817251:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772539.817256:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.817288:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 9 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.817302:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 9 pid: 12032 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.817318:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1877760813379712:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772539.817424:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9327836df780 going to sleep for 11 seconds 00000100:00100000:2.0:1790772539.820609:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.820757:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604800 00000100:00100000:1.0:1790772539.820767:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604800 00010000:00010000:1.0:1790772539.820809:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 10 pid: 12032 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.820856:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1790772539.820866:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2354:x1877760796604800:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772539.820934:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772539.820960:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 10 pid: 12032 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.820974:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 10 pid: 12032 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.821021:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772539.821026:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772539.821035:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.821046:0:8465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.821085:0:8465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.821100:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba66b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8465:1877760813379840:192.168.201.34@tcp:105: 00000100:00100000:1.0:1790772539.821172:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98863c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790772539.821823:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7c2965/0xd3c7635991be210c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b0a expref: 10 pid: 12032 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772539.821845:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1877760813379712:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772539.821868:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.821936:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519600, rc 0) 00000100:00100000:0.0:1790772539.821980:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:11487:x1877760796604672:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4827us (5006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.821989:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1790772539.825147:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba66b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8465:1877760813379840:192.168.201.34@tcp:105: 00010000:00010000:1.0:1790772539.825177:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772539.825238:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796604800:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4372us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.825249:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1790772539.830257:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.830421:0:6709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796604928 00000100:00100000:0.0:1790772539.830432:0:6709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796604928 00002000:00100000:0.0:1790772539.830487:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9328ba669c00 x1877760796604928/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:130/0 lens 504/0 e 0 to 0 dl 1790772550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772539.830499:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328ba669c00 with x1877760796604928 ext(0->8) 00002000:00010000:0.0:1790772539.830505:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328ba669c00 00000100:00100000:0.0:1790772539.830537:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1790772539.830547:0:6709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796604928:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790772539.831092:0:6709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2354:x1877760796604928:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 545us (842us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1790772539.831101:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00002000:00100000:0.0:1790772539.831109:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9328ba669c00 x1877760796604928/t4294967314(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:130/0 lens 504/448 e 0 to 0 dl 1790772550 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772539.831118:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328ba669c00 with x1877760796604928 ext(0->8) 00002000:00010000:0.0:1790772539.831122:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328ba669c00 00000100:00100000:3.0:1790772539.834396:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.834489:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796605056 00000100:00100000:1.0:1790772539.834500:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796605056 00000100:00100000:1.0:1790772539.834569:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:1.0:1790772539.834579:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11487:x1877760796605056:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790772539.877714:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000001:00080000:3.0:1790772539.877763:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1790772539.877771:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1790772539.877840:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1790772539.877857:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9328883dbcc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1790772539.877862:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf580d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9328883db780 00000020:00080000:3.0:1790772539.877865:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf580b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93288f14dc00 00000020:00080000:3.0:1790772539.878035:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790772539.878214:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790772539.878247:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813379968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790772539.878328:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772539.878386:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813379968 00000100:00100000:3.0:1790772539.878393:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813379968 00000100:00100000:3.0:1790772539.878438:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790772539.878448:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813379968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790772539.878476:0:12032:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1790772539.878516:0:12032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd0539, atime: 0x6abd0539, ctime: 0x6abd0539, blocks: 0xb 00010000:00010000:3.0:1790772539.878525:0:12032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.878540:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1790772539.878545:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772539.878561:0:12032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.878577:0:12032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.878587:0:12032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.878595:0:12032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.878613:0:12032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790772539.879101:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813379968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 652us (772us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790772539.879114:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1790772539.879141:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772539.879148:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.879158:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772539.879163:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.879173:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.879190:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.879199:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c1c7467/0xd3c7635991be211a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.879216:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772539.879218:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772539.879220:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772539.879244:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1790772539.879249:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1790772539.879266:0:3318:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9328c0e48700 x1877760813379968/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790772555 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1790772539.879278:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328c0e48700/2, rc 0, transno 4294967307 00000100:00100000:3.0:1790772539.879287:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813379968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790772539.879608:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11487:x1877760796605056:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 45028us (45220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772539.879622:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:2.0:1790772539.880056:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772539.880068:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813380096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772539.880107:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.880138:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813380096 00000100:00100000:2.0:1790772539.880143:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813380096 00000100:00100000:2.0:1790772539.880173:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790772539.880180:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813380096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790772539.880304:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790772539.880308:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790772540 00002000:00010000:2.0:1790772539.880311:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790772539.880313:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790772540 -> 1790772540 00002000:00010000:2.0:1790772539.880316:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790772539.880346:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1877760813380096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (238us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790772539.880351:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1790772539.880378:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328bfc07480/2, rc 0, transno 4294967315 00000100:00100000:2.0:1790772539.880383:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813380096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772539.883216:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.883299:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796605184 00000100:00100000:3.0:1790772539.883310:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796605184 00000100:00100000:3.0:1790772539.883376:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1790772539.883386:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2355:x1877760796605184:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790772539.937278:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1790772539.937303:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1790772539.937407:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796605184:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 54014us (54192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772539.937421:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1790772539.943460:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.943927:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796605440 00000100:00100000:1.0:1790772539.943939:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796605440 00000100:00100000:1.0:1790772539.944004:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:1.0:1790772539.944014:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11487:x1877760796605440:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.944085:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772539.944120:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b03 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.944142:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:1.0:1790772539.944147:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772539.944188:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.944204:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.944215:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772539.944483:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7b37830 reply state 00000000e27b157a transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.944492:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772539.944692:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:11487:x1877760796605440:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 677us (1240us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1790772539.944700:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:1.0:1790772539.949033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772539.949074:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796605568 00010000:00010000:1.0:1790772539.949078:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.949084:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796605568 00010000:00010000:1.0:1790772539.949090:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.949097:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.949102:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772539.949107:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.949114:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.949129:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00000100:00100000:2.0:1790772539.949130:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00010000:00010000:1.0:1790772539.949132:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772539.949137:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.949139:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796605568:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.949143:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2121 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772539.949382:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790772539.949386:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790772540 -> 1790772539 00002000:00010000:2.0:1790772539.949388:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790772537 00002000:00010000:2.0:1790772539.949391:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790772540 -> 1790772539 00002000:00010000:2.0:1790772539.949393:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790772539.949458:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796605568:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 320us (434us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790772539.949466:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1790772539.952268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.952432:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796605824 00000100:00100000:1.0:1790772539.952443:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796605824 00000100:00100000:1.0:1790772539.952504:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:1.0:1790772539.952514:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11487:x1877760796605824:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790772539.952607:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.952625:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.952641:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.952681:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772539.952697:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 18 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.952711:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba66aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813380224:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772539.953138:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772539.956475:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772539.956477:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba66aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813380224:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772539.956502:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.956505:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796605952 00000100:00100000:3.0:1790772539.956511:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796605952 00010000:00010000:3.0:1790772539.956563:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.956610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1790772539.956618:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:2354:x1877760796605952:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772539.956633:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772539.956639:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956651:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956673:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be20e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50af5 expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956690:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:3.0:1790772539.956695:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956715:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956722:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956744:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772539.956797:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:2354:x1877760796605952:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 180us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.956804:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00010000:00010000:3.0:1790772539.956944:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956953:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956980:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956987:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956993:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.956999:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772539.957004:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.957011:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.957027:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:3.0:1790772539.957030:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790772539.957034:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.957040:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2128 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.957084:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:11487:x1877760796605824:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 4572us (4821us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790772539.957093:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:2.0:1790772539.966011:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.966195:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796606080 00000100:00100000:0.0:1790772539.966206:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796606080 00000100:00100000:0.0:1790772539.966255:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1790772539.966265:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796606080:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790772539.966306:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.966326:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.966336:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772539.966341:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772539.966345:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.966393:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.966410:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 8 pid: 6706 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772539.966425:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1877760813380352:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772539.966515:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288391e480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772539.969382:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1877760813380352:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772539.969413:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772539.972078:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772539.973388:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796606208 00000100:00100000:3.0:1790772539.973403:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796606208 00010000:00010000:3.0:1790772539.974395:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 9 pid: 6706 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.974452:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1790772539.974465:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796606208:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772539.974481:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772539.974505:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 9 pid: 6706 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.974519:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 9 pid: 6706 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.974541:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bace39e5/0xd3c7635991be2113 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b11 expref: 9 pid: 6706 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.974579:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772539.974583:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772539.974589:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.974599:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.974632:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772539.974693:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796606208:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 231us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.974700:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00010000:00010000:2.0:1790772539.975156:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975168:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975193:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975201:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975209:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975215:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772539.975219:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975226:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975238:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.975245:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018218750/0xd3c7635991be212f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.975315:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796606080:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 9051us (9314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.975323:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1790772539.978031:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.978695:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796606464 00000100:00100000:0.0:1790772539.978707:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796606464 00000100:00100000:2.0:1790772539.978896:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:2.0:1790772539.978907:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+17:11487:x1877760796606464:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772539.978986:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979003:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979014:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979213:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979224:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979232:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979263:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.979275:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 18 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.979304:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813380480:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772539.979378:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328883dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772539.986844:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772539.986957:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813380480:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772539.986984:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.987457:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796606592 00000100:00100000:3.0:1790772539.987466:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796606592 00010000:00010000:3.0:1790772539.987506:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772539.987558:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:3.0:1790772539.987569:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:2355:x1877760796606592:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772539.987585:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772539.987660:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.987676:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.987714:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be20f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50afc expref: 19 pid: 5856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.987730:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:3.0:1790772539.987735:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.987744:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.987751:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772539.987780:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772539.987903:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:2355:x1877760796606592:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 334us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772539.987922:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00010000:00010000:0.0:1790772539.988060:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772539.988068:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772539.988225:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1790772539.988372:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1790772539.988416:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1790772539.988496:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813380608:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790772539.988560:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772539.988602:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772539.991963:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813380608 00000100:00100000:2.0:1790772539.991978:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813380608 00000100:00100000:2.0:1790772539.992057:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772539.992069:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877760813380608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790772539.992192:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877760813380608:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772539.992200:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772539.992251:0:5855:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790772539.992258:0:5855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328bfc07480, transno 4294967315 00000100:00100000:2.0:1790772539.992272:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813380608:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790772539.994228:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1790772539.994308:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813380736:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790772539.994370:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772539.994409:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328883db780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772539.994599:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813380736 00000100:00100000:1.0:1790772539.994608:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813380736 00000100:00100000:1.0:1790772539.994658:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772539.994667:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1877760813380736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790772539.994858:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1877760813380736:12345-0@lo:1000:mdt00_000.0 Request processed in 191us (487us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790772539.994866:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772539.994949:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5855:1877760813380736:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790772539.994985:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.994995:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995003:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995022:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772539.995028:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995036:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995051:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff932884f65a00) 00010000:00010000:2.0:1790772539.995054:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772539.995059:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995066:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be213d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995096:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995103:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995110:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995115:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772539.995118:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995124:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995143:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:2.0:1790772539.995146:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772539.995149:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995154:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2072 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995173:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995187:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995195:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995219:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772539.995232:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 21 pid: 5857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772539.995242:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813380864:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772539.995313:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328883db780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772540.005984:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.006023:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796606720 00000100:00100000:3.0:1790772540.006032:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796606720 00010000:00010000:3.0:1790772540.006086:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 22 pid: 5857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772540.006128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:3.0:1790772540.006138:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:2355:x1877760796606720:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772540.006156:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772540.006162:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 22 pid: 5857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.006188:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 22 pid: 5857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.006210:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:3.0:1790772540.006215:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.006224:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.006232:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.006251:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772540.006303:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:2355:x1877760796606720:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 166us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772540.006311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00080000:3.0:1790772540.006333:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790772540.006952:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9400/0xd3c7635991be208e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ae0 expref: 21 pid: 5857 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.006984:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813380864:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772540.007006:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007014:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007019:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007031:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007037:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007044:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007050:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.007055:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007062:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007074:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:1.0:1790772540.007077:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772540.007081:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007095:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519000/0xd3c7635991be2144 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007106:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007112:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007117:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007121:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.007124:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007129:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007137:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3e00) 00010000:00010000:1.0:1790772540.007138:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772540.007141:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.007146:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2136 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.007363:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11487:x1877760796606464:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 28458us (29340us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1790772540.007373:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 185 00000020:00080000:1.0:1790772540.007383:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790772540.007948:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772540.007953:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772540.008423:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1790772540.008432:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790772540.011457:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772540.011534:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796606976 00000100:00100000:1.0:1790772540.011545:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796606976 00000100:00100000:1.0:1790772540.011828:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1790772540.011840:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11487:x1877760796606976:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790772540.012514:0:5858:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790772540.012816:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790772540.012864:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.012911:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.012922:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.012931:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.012937:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.012944:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.012962:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790772540.013067:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:11487:x1877760796606976:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1226us (1619us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790772540.013076:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000020:00080000:1.0:1790772540.013082:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772540.013186:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772540.013194:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.013202:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772540.013206:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.013215:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.013227:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9328a16c3800) 00010000:00010000:0.0:1790772540.013231:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790772540.013236:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.013242:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be214b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.013257:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772540.013259:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772540.013261:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772540.173943:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772540.305273:0:12473:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772540.305283:0:12473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772540.305319:0:12473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790772540.305325:0:12473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772540.481294:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772540.481403:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796607232 00000100:00100000:1.0:1790772540.481430:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796607232 00000100:00100000:1.0:1790772540.481496:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:1.0:1790772540.481506:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:11497:x1877760796607232:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772540.481533:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772540.481565:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b18 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.481679:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2159 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.481696:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.481708:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2159 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772540.481720:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790772540.481849:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b18 expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.481868:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2159 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b18 expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.481925:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772540.481928:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772540.481932:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da800, rc 0) 00000100:00100000:1.0:1790772540.481988:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11497:x1877760796607232:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 484us (703us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1790772540.481996:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:3.0:1790772540.486072:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772540.486167:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796607360 00000100:00100000:1.0:1790772540.486179:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796607360 00000100:00100000:1.0:1790772540.486255:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:1.0:1790772540.486266:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11497:x1877760796607360:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:1.0:1790772540.486339:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486356:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486368:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486381:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486388:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486394:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486644:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486653:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486660:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772540.486697:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486716:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486723:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486729:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486735:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.486739:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486747:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486759:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772540.486762:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772540.486767:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486773:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486783:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486790:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486796:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486808:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.486811:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486817:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486825:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328a16c3e00) 00010000:00010000:1.0:1790772540.486827:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772540.486830:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486836:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be216e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486852:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486859:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486865:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486871:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.486905:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486913:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486931:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772540.486933:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772540.486935:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.486941:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.487018:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11497:x1877760796607360:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 753us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772540.487026:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:2.0:1790772540.571295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772540.571340:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796607616 00000100:00100000:2.0:1790772540.571360:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796607616 00000100:00100000:2.0:1790772540.571411:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:2.0:1790772540.571422:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11500:x1877760796607616:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772540.571444:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772540.571465:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be217c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b1f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571534:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571563:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571575:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571590:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571597:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571604:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571863:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571872:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.571920:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772540.571939:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790772540.572030:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572040:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572048:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572055:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.572060:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572069:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572080:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:2.0:1790772540.572083:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.572088:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572094:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572106:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572113:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572130:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572135:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.572138:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572145:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572154:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328a1803f00) 00010000:00010000:2.0:1790772540.572156:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.572160:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572166:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be218a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572209:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be217c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 27 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572223:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.572231:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772540.572233:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772540.572235:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519800, rc 0) 00000100:00100000:2.0:1790772540.572296:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11500:x1877760796607616:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 876us (1011us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1790772540.572313:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:2.0:1790772540.587807:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772540.589150:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796607744 00000100:00100000:0.0:1790772540.589165:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796607744 00000100:00100000:0.0:1790772540.589362:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:0.0:1790772540.589373:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11500:x1877760796607744:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1790772540.589444:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589460:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589470:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589497:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589504:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589511:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589516:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772540.589521:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589529:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589555:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772540.589558:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772540.589564:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.589570:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be219f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772540.589821:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11500:x1877760796607744:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 449us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772540.589829:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:3.0:1790772540.613100:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.613143:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796608000 00000100:00100000:3.0:1790772540.613154:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796608000 00000100:00100000:3.0:1790772540.613212:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1790772540.613223:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11500:x1877760796608000:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772540.613471:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:11500:x1877760796608000:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 249us (381us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790772540.613479:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1790772540.656778:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772540.656930:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796608256 00000100:00100000:1.0:1790772540.656940:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796608256 00000100:00100000:1.0:1790772540.657034:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:1.0:1790772540.657044:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:11035:x1877760796608256:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772540.657073:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772540.657096:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be21a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b26 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.657207:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.657223:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.657232:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.657271:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.657300:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 28 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.657313:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0b4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813380992:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772540.657421:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b98866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772540.661114:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0b4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813380992:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772540.661144:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772540.661821:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772540.661933:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796608384 00000100:00100000:1.0:1790772540.661942:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796608384 00010000:00010000:1.0:1790772540.661980:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 29 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.662018:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1790772540.662028:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:2354:x1877760796608384:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772540.662043:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772540.662049:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 29 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.662059:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 29 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.662079:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b1f expref: 29 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.662111:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772540.662116:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.662126:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.662133:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.662165:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772540.662215:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:2354:x1877760796608384:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 188us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772540.662223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00010000:00010000:2.0:1790772540.662488:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.662496:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772540.662514:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790772540.662676:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be21a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.662692:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.662700:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772540.662703:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772540.662706:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030800, rc 0) 00000100:00100000:2.0:1790772540.662748:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:11035:x1877760796608256:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5705us (5981us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1790772540.662756:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:2.0:1790772540.667817:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.667922:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796608640 00000100:00100000:3.0:1790772540.667933:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796608640 00000100:00100000:3.0:1790772540.668001:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:3.0:1790772540.668011:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:11035:x1877760796608640:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1790772540.668295:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.668316:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.668327:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772540.668385:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1790772540.668410:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000029b17532 reply state 0000000075c4e34d transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772540.668419:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790772540.668466:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1790772540.668605:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11035:x1877760796608640:12345-192.168.201.34@tcp:36:bash.0 Request processed in 594us (794us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1790772540.668630:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00000020:00080000:3.0:1790772540.668636:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790772540.671201:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.671219:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.671241:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.671248:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.671253:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.671261:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.671278:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772540.671282:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.671287:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.671294:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be21bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772540.673470:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772540.673847:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796608768 00000100:00100000:0.0:1790772540.673861:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796608768 00000100:00100000:0.0:1790772540.673965:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:0.0:1790772540.673975:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:11035:x1877760796608768:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772540.674002:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772540.674027:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be21c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b2d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.674107:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be21c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b2d expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.674123:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be21c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b2d expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.674145:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772540.674148:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772540.674152:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:0.0:1790772540.674228:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11035:x1877760796608768:12345-192.168.201.34@tcp:101:bash.0 Request processed in 254us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772540.674235:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:0.0:1790772540.678139:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772540.678238:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796608896 00000100:00100000:2.0:1790772540.678249:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796608896 00000100:00100000:2.0:1790772540.678310:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1790772540.678320:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:11035:x1877760796608896:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772540.678338:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772540.678359:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b34 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772540.678384:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd053b, atime: 0x6abd0539, ctime: 0x6abd053b, blocks: 0xb 00010000:00010000:2.0:1790772540.678407:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1790772540.678425:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772540.678435:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.678453:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.678466:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519000, rc 0) 00000100:00100000:2.0:1790772540.678529:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:11035:x1877760796608896:12345-192.168.201.34@tcp:101:bash.0 Request processed in 210us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772540.678545:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1790772540.681368:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.681475:0:6710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796609024 00000100:00100000:3.0:1790772540.681486:0:6710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796609024 00002000:00010000:3.0:1790772540.681528:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1790772540.681542:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c0b4b480 with x1877760796609024 ext(0->18446744073709551615) 00002000:00010000:3.0:1790772540.681553:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c0b4b480. 00000100:00100000:3.0:1790772540.681641:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772540.681652:0:6710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2357:x1877760796609024:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:3.0:1790772540.681976:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790772540.681980:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790772539 -> 1790772541 00002000:00010000:3.0:1790772540.681982:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790772537 -> 1790772537 00002000:00010000:3.0:1790772540.681985:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790772539 -> 1790772541 00002000:00010000:3.0:1790772540.681987:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790772540.682053:0:6710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2357:x1877760796609024:12345-192.168.201.34@tcp:10:bash.0 Request processed in 402us (694us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790772540.682061:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00002000:00010000:3.0:1790772540.682065:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1790772540.682067:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c0b4b480 with x1877760796609024 ext(0->18446744073709551615) 00002000:00010000:3.0:1790772540.682072:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c0b4b480. 00000100:00100000:3.0:1790772540.778772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772540.778861:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796609152 00000100:00100000:2.0:1790772540.778870:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796609152 00000100:00100000:2.0:1790772540.778975:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:2.0:1790772540.778985:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11514:x1877760796609152:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1790772540.779063:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779083:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779095:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779112:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779119:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779145:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779367:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779377:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779384:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772540.779424:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779435:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779442:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779447:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779453:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.779457:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779465:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779477:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:2.0:1790772540.779485:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.779491:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779497:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be21d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779510:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779516:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779522:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779527:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.779530:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779549:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779557:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328a1803d00) 00010000:00010000:2.0:1790772540.779559:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.779561:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779567:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be21d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779582:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779594:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779600:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779605:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.779609:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.779866:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.780078:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772540.780082:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.780086:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.780093:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be21de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772540.780249:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11514:x1877760796609152:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1263us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772540.780259:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:2.0:1790772540.818422:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772540.818521:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796609408 00000100:00100000:0.0:1790772540.818540:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796609408 00000100:00100000:0.0:1790772540.818630:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:0.0:1790772540.818640:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+32:11517:x1877760796609408:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772540.818662:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772540.818688:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be21e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b3b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.818765:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.818782:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.818793:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.818807:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.818815:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.818821:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819134:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be21fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819145:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be21fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819153:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be21fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772540.819174:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790772540.819268:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819277:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819283:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819290:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772540.819295:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819303:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819315:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772540.819318:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772540.819323:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819330:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be21ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819342:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819348:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819364:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819369:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772540.819372:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819379:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819386:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328829d4c00) 00010000:00010000:0.0:1790772540.819389:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772540.819392:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819398:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be21f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819439:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be21e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b3b expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819454:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be21fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b3b expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.819461:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772540.819463:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772540.819466:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93600, rc 0) 00000100:00100000:0.0:1790772540.819552:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:11517:x1877760796609408:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 914us (1141us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1790772540.819570:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:1.0:1790772540.823356:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772540.823478:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796609536 00000100:00100000:0.0:1790772540.823491:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796609536 00000100:00100000:0.0:1790772540.823570:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:0.0:1790772540.823591:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:11517:x1877760796609536:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1790772540.823675:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.823693:0:8380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.823702:0:8380:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.823737:0:8380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.823751:0:8380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 34 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772540.823766:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813381120:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772540.823869:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1790772540.828386:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772540.828477:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796609792 00000100:00100000:1.0:1790772540.828488:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796609792 00000100:00100000:1.0:1790772540.828553:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1790772540.828564:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:5594:x1877760796609792:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790772540.828981:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:5594:x1877760796609792:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 418us (603us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790772540.828990:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1790772540.829642:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813381120:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772540.829670:0:8380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.832252:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.832363:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796609920 00000100:00100000:3.0:1790772540.832373:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796609920 00010000:00010000:3.0:1790772540.832416:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 36 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772540.832483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:3.0:1790772540.832492:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:2355:x1877760796609920:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772540.832507:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772540.832514:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 36 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.832528:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 36 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.832559:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be21ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b26 expref: 36 pid: 5856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.832577:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:3.0:1790772540.832591:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.832600:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.832608:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772540.832638:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772540.832707:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:2355:x1877760796609920:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 215us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772540.832715:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:1.0:1790772540.833185:0:8380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833209:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833243:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833251:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833257:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833263:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.833268:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833275:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833288:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772540.833291:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772540.833295:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.833300:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be2208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772540.833360:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:11517:x1877760796609536:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 9780us (10013us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772540.833368:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:1.0:1790772540.838415:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.838494:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796610176 00000100:00100000:3.0:1790772540.838519:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796610176 00000100:00100000:3.0:1790772540.838595:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1790772540.838606:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+34:11517:x1877760796610176:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772540.838865:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:11517:x1877760796610176:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 260us (459us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790772540.838927:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1790772540.933110:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772540.933215:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796610432 00000100:00100000:0.0:1790772540.933241:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796610432 00000100:00100000:0.0:1790772540.933305:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:0.0:1790772540.933315:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+35:11528:x1877760796610432:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1790772540.933345:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772540.933371:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be220f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b42 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933461:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933478:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933491:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933505:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933512:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933519:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933824:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933835:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933843:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772540.933859:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1790772540.933987:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.933996:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934005:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934012:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772540.934017:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934026:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934039:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772540.934042:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772540.934047:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934054:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934067:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934074:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934090:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934096:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772540.934099:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934105:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934113:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328829d4c00) 00010000:00010000:0.0:1790772540.934115:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772540.934118:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934124:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be221d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934172:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be220f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b42 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934186:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b42 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772540.934193:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772540.934195:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772540.934198:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92c00, rc 0) 00000100:00100000:0.0:1790772540.934274:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:11528:x1877760796610432:12345-192.168.201.34@tcp:101:cat.0 Request processed in 960us (1174us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1790772540.934291:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:2.0:1790772540.939101:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772540.939197:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796610688 00000100:00100000:3.0:1790772540.939208:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796610688 00000100:00100000:3.0:1790772540.939267:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1790772540.939277:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:11528:x1877760796610688:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:3.0:1790772540.939503:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11528:x1877760796610688:12345-192.168.201.34@tcp:35:cat.0 Request processed in 228us (413us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1790772540.939509:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1790772540.978523:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772540.978673:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796610944 00000100:00100000:2.0:1790772540.978685:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796610944 00000100:00100000:2.0:1790772540.978748:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:2.0:1790772540.978775:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11529:x1877760796610944:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1790772540.978848:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790772540.978920:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b42 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.978945:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be21fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b3b expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.978958:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be21c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b2d expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.978967:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772540.978978:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772540.979000:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979013:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979023:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979038:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979046:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979052:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979294:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979303:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.979310:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772540.981035:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790772540.981056:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361801180487ns, next at 362801175854ns, rc = 0 00010000:00010000:2.0:1790772540.981151:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981167:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981178:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981187:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981193:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981200:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981288:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772540.981313:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981333:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981340:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981347:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.981351:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981359:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981371:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803800) 00010000:00010000:2.0:1790772540.981374:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790772540.981380:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981386:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2240 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981407:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981413:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981419:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981424:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772540.981435:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981442:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981451:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:2.0:1790772540.981454:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772540.981457:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772540.981462:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be2232 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772540.981472:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000026136530 reply state 000000008a110300 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772540.981481:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772540.981615:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+37:11529:x1877760796610944:12345-192.168.201.34@tcp:36:rm.0 Request processed in 2839us (3099us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1790772540.982183:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 197 00010000:00010000:1.0:1790772540.986319:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772540.986334:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.986345:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772540.986349:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.986359:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.986376:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9328a1803800) 00010000:00010000:1.0:1790772540.986379:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790772540.986383:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.986389:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be2247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.986411:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772540.986413:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772540.986415:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772540.990409:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.990426:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.990433:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.990459:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772540.990464:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.990472:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.990486:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328a1803d00) 00010000:00010000:1.0:1790772540.990489:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772540.990493:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772540.990500:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2239 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772541.076417:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.076726:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796611200 00000100:00100000:0.0:1790772541.076737:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796611200 00000100:00100000:0.0:1790772541.076802:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:0.0:1790772541.076812:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+36:11536:x1877760796611200:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772541.076849:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.076916:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be224e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b49 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077043:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077060:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077071:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077088:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077095:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077102:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772541.077740:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790772541.077943:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077964:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.077973:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078010:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078017:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078024:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078030:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772541.078033:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078041:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078052:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772541.078055:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772541.078059:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078065:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2255 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772541.078077:0:5857:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ea3662f1 reply state 0000000081443092 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.078092:0:5857:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772541.078127:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be224e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078142:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.078149:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:0.0:1790772541.078152:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772541.078154:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93600, rc 0) 00000100:00100000:0.0:1790772541.078226:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:11536:x1877760796611200:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1416us (1822us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1790772541.078235:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00010000:00010000:0.0:1790772541.081108:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.081130:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.081138:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.081143:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772541.081148:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.081155:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.081192:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328829d4c00) 00010000:00010000:0.0:1790772541.081195:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772541.081200:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.081207:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be225c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772541.094105:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.094996:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796611328 00000100:00100000:0.0:1790772541.095007:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796611328 00000100:00100000:0.0:1790772541.095088:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:0.0:1790772541.095098:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796611328:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772541.095117:0:12032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.095139:0:12032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b50 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772541.095166:0:12032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772541.095184:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1790772541.095188:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772541.095197:0:12032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 6 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.095215:0:12032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 6 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.095228:0:12032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92a00, rc 0) 00000100:00100000:0.0:1790772541.095306:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2354:x1877760796611328:12345-192.168.201.34@tcp:101:bash.0 Request processed in 210us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.095314:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00080000:3.0:1790772541.095801:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772541.099067:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.099167:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796611456 00000100:00100000:0.0:1790772541.099179:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796611456 00000100:00100000:0.0:1790772541.099278:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1790772541.099288:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:11536:x1877760796611456:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772541.099306:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.099323:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b57 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.099360:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.099370:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772541.099374:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772541.099380:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.099412:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.099426:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.099440:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813381248:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772541.099556:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886cec000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772541.102165:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1877760813381248:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772541.102204:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.102224:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93400, rc 0) 00000100:00100000:0.0:1790772541.102287:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:11536:x1877760796611456:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3000us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.102297:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1790772541.103178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.103259:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796611584 00000100:00100000:2.0:1790772541.103268:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796611584 00010000:00010000:2.0:1790772541.103301:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.103338:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1790772541.103348:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796611584:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772541.103363:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772541.103398:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.103410:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.103433:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3bbb3fd/0xd3c7635991be2271 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b50 expref: 7 pid: 12032 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.103449:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772541.103453:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772541.103460:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.103469:0:5841:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.103506:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.103520:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5841:1877760813381376:192.168.201.34@tcp:105: 00000100:00100000:2.0:1790772541.103717:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328883db480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772541.108236:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5841:1877760813381376:192.168.201.34@tcp:105: 00010000:00010000:1.0:1790772541.108264:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772541.108324:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796611584:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4976us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.108335:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1790772541.108858:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.108958:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796611840 00000100:00100000:3.0:1790772541.108966:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796611840 00000100:00100000:3.0:1790772541.109017:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1790772541.109026:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+38:11536:x1877760796611840:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1790772541.109358:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:11536:x1877760796611840:12345-192.168.201.34@tcp:35:bash.0 Request processed in 332us (500us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1790772541.109365:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:0.0:1790772541.195223:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772541.290958:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.291093:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796611968 00000100:00100000:0.0:1790772541.291102:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796611968 00000100:00100000:0.0:1790772541.291155:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:0.0:1790772541.291162:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+39:11552:x1877760796611968:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772541.291184:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.291203:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be227f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b5e expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.291309:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.291325:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.291335:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772541.291370:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790772541.291381:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772541.291402:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.291430:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be227f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b5e expref: 41 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.291450:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b5e expref: 40 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.291459:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772541.291461:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772541.291465:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92c00, rc 0) 00000100:00100000:0.0:1790772541.291542:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:11552:x1877760796611968:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 379us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.291549:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:2.0:1790772541.303365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.303483:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796612224 00000100:00100000:0.0:1790772541.303495:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796612224 00000100:00100000:0.0:1790772541.303604:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:0.0:1790772541.303616:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+40:11552:x1877760796612224:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772541.303640:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.303666:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be228d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b65 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.303782:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.303799:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.304027:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772541.304042:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790772541.304208:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be228d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b65 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.304318:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b65 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.304330:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:0.0:1790772541.304333:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772541.304337:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93800, rc 0) 00000100:00100000:0.0:1790772541.304519:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:11552:x1877760796612224:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 905us (1162us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1790772541.304536:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:1.0:1790772541.317059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.319925:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796612480 00000100:00100000:0.0:1790772541.319941:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796612480 00000100:00100000:0.0:1790772541.320021:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:0.0:1790772541.320033:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+42:11552:x1877760796612480:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772541.320058:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.320078:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be22a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b6c expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.320175:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be22a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.320208:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be22a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.320220:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be22a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772541.320455:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790772541.320600:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be22a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b6c expref: 45 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.320620:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be22a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b6c expref: 44 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.322965:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:0.0:1790772541.322970:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790772541.322975:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93c00, rc 0) 00000100:00100000:0.0:1790772541.323067:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:11552:x1877760796612480:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 3031us (6013us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1790772541.323076:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:2.0:1790772541.323680:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.324992:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796612608 00000100:00100000:0.0:1790772541.325008:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796612608 00000100:00100000:0.0:1790772541.325131:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1790772541.325142:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+44:2354:x1877760796612608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772541.325159:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772541.325184:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b65 expref: 44 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.325221:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:0.0:1790772541.325226:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772541.325305:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+43:2354:x1877760796612608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 165us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.325313:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772541.334164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.334290:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796612736 00000100:00100000:0.0:1790772541.334301:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796612736 00000100:00100000:0.0:1790772541.334362:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1790772541.334373:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+6:2355:x1877760796612736:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1790772541.334419:0:12032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.334439:0:12032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.334449:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790772541.334454:0:12032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772541.334459:0:12032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.334495:0:12032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.334747:0:12032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 6 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.334779:0:12032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12032:1877760813381504:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772541.334914:0:12032:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886cec180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772541.338147:0:12032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12032:1877760813381504:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772541.338179:0:12032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.339991:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772541.340240:0:6711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796612864 00000100:00100000:1.0:1790772541.340252:0:6711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796612864 00002000:00100000:1.0:1790772541.340304:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93288f3a7480 x1877760796612864/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:132/0 lens 504/0 e 0 to 0 dl 1790772552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772541.340329:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93288f3a7480 with x1877760796612864 ext(0->8) 00010000:00010000:1.0:1790772541.340341:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 7 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.340360:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 7 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772541.340368:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93288f3a7480 00000100:00100000:1.0:1790772541.340407:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1790772541.340417:0:6711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796612864:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:1.0:1790772541.340966:0:6711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2355:x1877760796612864:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 549us (981us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790772541.340975:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00100000:1.0:1790772541.340982:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93288f3a7480 x1877760796612864/t4294967308(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:132/0 lens 504/448 e 0 to 0 dl 1790772552 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772541.340991:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93288f3a7480 with x1877760796612864 ext(0->8) 00010000:00010000:1.0:1790772541.340998:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 9 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.341012:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 9 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772541.341020:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93288f3a7480 00000100:00100000:2.0:1790772541.344585:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.344685:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796612992 00000100:00100000:3.0:1790772541.344696:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796612992 00010000:00010000:3.0:1790772541.344740:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 9 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.344806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:3.0:1790772541.344817:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2356:x1877760796612992:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772541.344835:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790772541.344855:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790772541.344858:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790772541 00002000:00010000:3.0:1790772541.344860:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790772541 00002000:00010000:3.0:1790772541.344862:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790772541 00010000:00010000:3.0:1790772541.344868:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 9 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.344935:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 9 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.344958:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e222130d/0xd3c7635991be2278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b57 expref: 9 pid: 6704 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.344975:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772541.344980:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772541.344987:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.344995:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.345019:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772541.345089:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2356:x1877760796612992:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 273us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772541.345097:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00010000:00010000:0.0:1790772541.345249:0:12032:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345259:0:12032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345285:0:12032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345294:0:12032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345302:0:12032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345308:0:12032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772541.345313:0:12032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345335:0:12032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345348:0:12032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.345356:0:12032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018218750/0xd3c7635991be22b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.345407:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796612736:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 11037us (11256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.345416:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:2.0:1790772541.348977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.349261:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796613248 00000100:00100000:3.0:1790772541.349272:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796613248 00000100:00100000:3.0:1790772541.349333:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1790772541.349343:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+43:11552:x1877760796613248:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:3.0:1790772541.349410:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be22a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b6c expref: 43 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772541.349690:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1790772541.349734:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1790772541.350252:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1790772541.350312:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.350329:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.350338:0:5858:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.350375:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.350391:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 47 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.350407:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b933f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5858:1877760813381632:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772541.351310:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790772541.354810:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772541.354939:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796613376 00000100:00100000:1.0:1790772541.354964:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796613376 00010000:00010000:1.0:1790772541.355011:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 48 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772541.355045:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:1.0:1790772541.355054:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:2354:x1877760796613376:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772541.355068:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772541.355074:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 48 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.355088:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 48 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.355110:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:1.0:1790772541.355116:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.355125:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.355132:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.355149:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772541.355207:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+48:2354:x1877760796613376:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 154us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.355216:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00010000:00010000:3.0:1790772541.356372:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b49 expref: 47 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.356394:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b933f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5858:1877760813381632:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772541.356416:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.356426:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.356431:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772541.356591:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1790772541.356792:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1790772541.357097:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b933f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813381760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790772541.357158:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772541.357195:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772541.357484:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813381760 00000100:00100000:1.0:1790772541.357492:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813381760 00000100:00100000:1.0:1790772541.357644:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772541.357655:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1877760813381760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790772541.357749:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1877760813381760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.357757:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772541.357844:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b933f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813381760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772541.358329:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1790772541.358397:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813381888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790772541.358448:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790772541.358516:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772541.359801:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328883dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772541.359846:0:5861:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813381888 00000100:00100000:0.0:1790772541.359855:0:5861:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813381888 00000100:00100000:0.0:1790772541.360136:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772541.360145:0:5861:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1877760813381888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790772541.360436:0:5861:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5858:x1877760813381888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 291us (1986us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790772541.360445:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772541.360706:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5858:1877760813381888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772541.360780:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790772541.360824:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.360835:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.360844:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.360850:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772541.360855:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.360864:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.361286:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:2.0:1790772541.361290:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790772541.361306:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.361314:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be22be lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772541.361498:0:5858:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790772541.361682:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1790772541.361693:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362181817475ns, next at 363181815670ns, rc = 0 00000001:00080000:2.0:1790772541.361700:0:5858:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1790772541.361734:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328829d4d00) 00010000:00010000:2.0:1790772541.361737:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790772541.361744:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be22a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b6c expref: 51 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.361851:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:11552:x1877760796613248:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 12509us (12884us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1790772541.361859:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000020:00080000:2.0:1790772541.361864:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790772541.364828:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772541.365125:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796613504 00000100:00100000:1.0:1790772541.365137:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796613504 00000100:00100000:1.0:1790772541.365201:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:1.0:1790772541.365212:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+50:11552:x1877760796613504:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772541.365240:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772541.365262:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be22c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b73 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.365324:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be22c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b73 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.365338:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be22c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b73 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.365358:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772541.365361:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772541.365364:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880031e00, rc 0) 00000100:00100000:1.0:1790772541.365431:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:11552:x1877760796613504:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 220us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.365437:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:1.0:1790772541.368662:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.368834:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796613760 00000100:00100000:3.0:1790772541.368846:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796613760 00000100:00100000:3.0:1790772541.369071:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:3.0:1790772541.369083:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+51:11552:x1877760796613760:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772541.369323:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11552:x1877760796613760:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 241us (670us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1790772541.369331:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1790772541.490228:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.490346:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796613888 00000100:00100000:3.0:1790772541.490366:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796613888 00000100:00100000:3.0:1790772541.490453:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:3.0:1790772541.490460:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11562:x1877760796613888:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1790772541.490582:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490597:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490606:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490619:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490623:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490627:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490696:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490700:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490704:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772541.490739:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490756:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490760:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490765:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490769:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772541.490772:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490777:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490786:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772541.490788:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772541.490791:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490795:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8c00/0xd3c7635991be22cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490808:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490812:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490816:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490823:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772541.490826:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490832:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490839:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff932884f65e00) 00010000:00010000:3.0:1790772541.490841:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772541.490844:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490849:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9600/0xd3c7635991be22d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490864:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490988:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.490997:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.491002:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772541.491005:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.491011:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.491030:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772541.491032:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772541.491035:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.491041:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be22da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.491161:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11562:x1877760796613888:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 700us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772541.491168:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:1.0:1790772541.521555:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.521708:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796614144 00000100:00100000:2.0:1790772541.521719:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796614144 00000100:00100000:2.0:1790772541.521783:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:2.0:1790772541.521794:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+52:11565:x1877760796614144:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772541.521822:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772541.521846:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be22e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b7a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522150:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522164:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522175:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522188:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522195:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522202:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522356:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522366:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522373:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772541.522382:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790772541.522515:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522532:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522546:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522552:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772541.522556:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522565:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522579:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:2.0:1790772541.522582:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772541.522586:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522592:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be22e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522606:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522613:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522619:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522624:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772541.522627:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522644:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522652:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328a1803e00) 00010000:00010000:2.0:1790772541.522655:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772541.522658:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522664:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be22ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522710:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be22e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522724:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.522732:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772541.522734:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772541.522737:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519800, rc 0) 00000100:00100000:2.0:1790772541.522934:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932888345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:11565:x1877760796614144:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1081us (1894us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1790772541.522944:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:1.0:1790772541.526920:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.527088:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796614272 00000100:00100000:0.0:1790772541.527100:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796614272 00000100:00100000:0.0:1790772541.527239:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:0.0:1790772541.527249:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:11565:x1877760796614272:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1790772541.527317:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527347:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527358:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527382:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527389:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527397:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527403:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772541.527407:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527414:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527425:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772541.527428:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772541.527432:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.527439:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.527512:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:11565:x1877760796614272:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 264us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.527538:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:1.0:1790772541.529962:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.530064:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796614528 00000100:00100000:3.0:1790772541.530076:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796614528 00000100:00100000:3.0:1790772541.530135:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1790772541.530144:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+54:11565:x1877760796614528:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1790772541.530378:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11565:x1877760796614528:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 233us (425us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1790772541.530386:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1790772541.610611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.610786:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796614784 00000100:00100000:0.0:1790772541.610797:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796614784 00000100:00100000:0.0:1790772541.610862:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:0.0:1790772541.610913:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11575:x1877760796614784:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772541.610938:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.610941:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772541.610969:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b5e expref: 55 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.610988:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772541.610995:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772541.611007:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be230b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b81 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.611106:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.611120:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.611129:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.611164:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.611180:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 55 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.611204:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813382016:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772541.611289:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886cec180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772541.614151:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813382016:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772541.614179:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772541.616144:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.616499:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796614912 00000100:00100000:3.0:1790772541.616511:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796614912 00010000:00010000:3.0:1790772541.616557:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.616604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1790772541.616614:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+56:2354:x1877760796614912:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772541.616628:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772541.616649:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.616661:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.616682:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be22f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b7a expref: 56 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.616699:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772541.616704:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.616714:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.616722:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772541.616756:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772541.616820:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:2354:x1877760796614912:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 207us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772541.616828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00010000:00010000:2.0:1790772541.617198:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.617207:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772541.617237:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790772541.617389:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be230b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.617405:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.617412:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772541.617415:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772541.617417:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93a00, rc 0) 00000100:00100000:2.0:1790772541.617459:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11575:x1877760796614784:12345-192.168.201.34@tcp:101:bash.0 Request processed in 6589us (6858us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1790772541.617466:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:1.0:1790772541.624605:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.624701:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796615168 00000100:00100000:2.0:1790772541.624711:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796615168 00000100:00100000:2.0:1790772541.624775:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:2.0:1790772541.624784:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+55:11575:x1877760796615168:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1790772541.625108:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.625126:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.625137:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772541.625184:0:5855:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1790772541.625224:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e786299 reply state 000000000abdecd2 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.625234:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772541.625323:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11575:x1877760796615168:12345-192.168.201.34@tcp:36:bash.0 Request processed in 539us (725us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790772541.625331:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 207 00000020:00080000:2.0:1790772541.625336:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790772541.629325:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:1.0:1790772541.629487:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.629501:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.629510:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.629516:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772541.629530:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.629539:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.629555:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772541.629559:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772541.629572:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.629579:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2320 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.629796:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796615296 00000100:00100000:2.0:1790772541.629809:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796615296 00000100:00100000:2.0:1790772541.629925:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:2.0:1790772541.629937:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11575:x1877760796615296:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772541.629959:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772541.629976:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b88 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.630054:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.630068:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.630075:0:5856:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.630108:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 58 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.630123:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 58 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.630164:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813382144:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772541.630240:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328912dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772541.633462:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5856:1877760813382144:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772541.633492:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.634983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772541.635285:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796615424 00000100:00100000:1.0:1790772541.635295:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796615424 00010000:00010000:1.0:1790772541.635335:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 59 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772541.635380:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:1.0:1790772541.635389:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:2355:x1877760796615424:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772541.635404:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772541.635410:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 59 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.635422:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 59 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.635443:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2312 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b81 expref: 59 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.635459:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772541.635464:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.635473:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.635480:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.635513:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772541.635592:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:2355:x1877760796615424:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 203us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.635600:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00010000:00010000:2.0:1790772541.635718:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.635727:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772541.635771:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790772541.635775:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772541.635794:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.635824:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.635839:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.635846:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772541.635849:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772541.635851:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518000, rc 0) 00000100:00100000:2.0:1790772541.635934:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11575:x1877760796615296:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5998us (6617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772541.635948:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:3.0:1790772541.640138:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.640229:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796615680 00000100:00100000:2.0:1790772541.640240:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796615680 00000100:00100000:2.0:1790772541.640299:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:2.0:1790772541.640309:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+57:11575:x1877760796615680:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1790772541.641095:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11575:x1877760796615680:12345-192.168.201.34@tcp:35:bash.0 Request processed in 264us (444us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1790772541.641104:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1790772541.709402:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.709499:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796615808 00000100:00100000:2.0:1790772541.709509:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796615808 00000100:00100000:2.0:1790772541.709587:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:2.0:1790772541.709598:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+58:11581:x1877760796615808:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772541.709625:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772541.709646:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b8f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.709712:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be233c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.709727:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be233c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.709739:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be233c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772541.709776:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790772541.709780:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772541.709815:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be233c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.709842:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b8f expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.709861:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be233c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b8f expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.709869:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:2.0:1790772541.709917:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772541.709922:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518800, rc 0) 00000100:00100000:2.0:1790772541.709983:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11581:x1877760796615808:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 387us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772541.709990:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:3.0:1790772541.714975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.715309:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796615936 00000100:00100000:0.0:1790772541.715321:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796615936 00000100:00100000:0.0:1790772541.715380:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:0.0:1790772541.715391:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11581:x1877760796615936:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772541.715415:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772541.715437:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b96 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715505:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715530:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715542:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715557:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715575:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715598:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715690:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715697:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715704:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772541.715738:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790772541.715743:0:5857:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772541.715761:0:5857:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715771:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715779:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715785:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715792:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715797:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772541.715801:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715816:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715828:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772541.715831:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772541.715836:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715841:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93200/0xd3c7635991be234a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715854:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715860:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715867:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.715910:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772541.716088:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.716095:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.716103:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328946b8300) 00010000:00010000:0.0:1790772541.716106:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772541.716109:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.716124:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.716158:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be2343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.716171:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.716178:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772541.716181:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772541.716184:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93a00, rc 0) 00000100:00100000:0.0:1790772541.716253:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11581:x1877760796615936:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 862us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.716261:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:3.0:1790772541.722032:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772541.722082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.722192:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796616192 00000100:00100000:2.0:1790772541.722204:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796616192 00000100:00100000:2.0:1790772541.722271:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:2.0:1790772541.722282:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11581:x1877760796616192:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772541.722311:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772541.722332:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be235f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50b9d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722442:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722457:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722477:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722486:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722529:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722543:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 61 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.722556:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813382272:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772541.722667:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.722677:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.722685:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813382400:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772541.722708:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328912dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772541.722923:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796616320 00000100:00100000:0.0:1790772541.722929:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796616320 00010000:00010000:0.0:1790772541.722952:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 62 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772541.722984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:0.0:1790772541.722992:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:2355:x1877760796616320:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772541.723002:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772541.723009:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 62 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.723032:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 62 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.723049:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772541.723053:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.723060:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.723065:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772541.723091:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:2355:x1877760796616320:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 100us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.723098:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00010000:00010000:2.0:1790772541.729436:0:5855:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.34@tcp) returned -22 from blocking AST (req@00000000688b2be5 x1877760813382272) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 61 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.729464:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b96 expref: 61 pid: 5857 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772541.729497:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813382272:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772541.729513:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813382400:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772541.729545:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772541.729551:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.729559:0:5855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.729631:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772541.732504:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772541.732671:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796616448 00000100:00100000:1.0:1790772541.732698:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796616448 00010000:00010000:1.0:1790772541.732743:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772541.732838:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1790772541.732848:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:2354:x1877760796616448:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772541.732866:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772541.733164:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.733183:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.733209:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be232e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b88 expref: 61 pid: 5856 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.733226:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772541.733230:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.733240:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.733247:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.733269:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772541.733378:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:2354:x1877760796616448:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 530us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.733397:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00010000:00010000:2.0:1790772541.733484:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.733493:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772541.733511:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790772541.733686:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be235f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.733700:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.733707:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772541.733710:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772541.733719:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518a00, rc 0) 00000100:00100000:2.0:1790772541.733745:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11581:x1877760796616192:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 11466us (11727us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790772541.733753:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:3.0:1790772541.737442:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772541.737535:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796616704 00000100:00100000:0.0:1790772541.737546:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796616704 00000100:00100000:0.0:1790772541.737673:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1790772541.737684:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11581:x1877760796616704:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:0.0:1790772541.737701:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772541.737724:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be22c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b73 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772541.737744:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772541.737748:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772541.737828:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11581:x1877760796616704:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 147us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772541.737851:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1790772541.741331:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772541.741424:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796616832 00000100:00100000:2.0:1790772541.741434:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796616832 00000100:00100000:2.0:1790772541.741532:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:2.0:1790772541.741544:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11581:x1877760796616832:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:2.0:1790772541.741673:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.741693:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772541.741704:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772541.743333:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1790772541.743445:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11581:x1877760796616832:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1898us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772541.743456:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:3.0:1790772541.746728:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772541.746807:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796616960 00000100:00100000:1.0:1790772541.746820:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796616960 00000100:00100000:1.0:1790772541.746911:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:1.0:1790772541.746921:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+59:11581:x1877760796616960:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772541.746943:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772541.746963:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ba4 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.747026:0:8380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.747038:0:8380:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 60 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.747058:0:8380:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.747072:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 60 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.747086:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772541.747089:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772541.747093:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 60 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772541.747101:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030800, rc 0) 00000100:00100000:1.0:1790772541.747196:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11581:x1877760796616960:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 276us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772541.747205:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000040:00080000:3.0:1790772542.091924:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772542.091937:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772542.092001:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1790772542.092009:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790772542.092141:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b933ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813382528:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772542.093341:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772542.099578:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b933ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813382528:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772542.102326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.102712:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796617088 00000100:00100000:0.0:1790772542.102723:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796617088 00000100:00080000:3.0:1790772542.102846:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772542.102909:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:0.0:1790772542.102920:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11582:x1877760796617088:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772542.102951:0:5857:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772542.103052:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11582:x1877760796617088:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 134us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.103059:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:3.0:1790772542.110081:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772542.111366:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796617216 00000100:00100000:1.0:1790772542.111463:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796617216 00000100:00100000:1.0:1790772542.111807:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:1.0:1790772542.111819:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11582:x1877760796617216:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790772542.111949:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.111970:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.111983:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112003:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112011:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112017:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112042:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112049:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112075:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772542.112116:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790772542.112121:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772542.112134:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112145:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112152:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112160:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112165:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.112170:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112176:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112187:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:1.0:1790772542.112190:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772542.112195:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112201:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030200/0xd3c7635991be2382 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112225:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112231:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112237:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112242:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880031e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.112245:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112250:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112257:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9328a16c3e00) 00010000:00010000:1.0:1790772542.112259:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772542.112262:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112267:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880031e00/0xd3c7635991be2389 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112281:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112287:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112293:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112302:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.112305:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112311:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112317:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772542.112319:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772542.112321:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.112327:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.112553:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11582:x1877760796617216:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 736us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772542.112667:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1790772542.117845:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.118191:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796617472 00000100:00100000:2.0:1790772542.118203:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796617472 00000100:00100000:2.0:1790772542.118297:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:2.0:1790772542.118309:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+60:11582:x1877760796617472:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.118336:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772542.118359:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2397 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bab expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118533:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118549:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118572:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772542.118585:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790772542.118708:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118717:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118724:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118730:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772542.118734:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118742:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118755:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772542.118758:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790772542.118764:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118780:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be239e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118827:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2397 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bab expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118839:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:2.0:1790772542.118841:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772542.118846:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be2397 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bab expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.118855:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519c00, rc 0) 00000100:00100000:2.0:1790772542.119162:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11582:x1877760796617472:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 854us (1326us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1790772542.119170:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:3.0:1790772542.123168:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.123266:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796617600 00000100:00100000:2.0:1790772542.123277:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796617600 00000100:00100000:2.0:1790772542.123327:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:2.0:1790772542.123337:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11582:x1877760796617600:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772542.123411:0:5855:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772542.123534:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11582:x1877760796617600:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 198us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.123543:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:3.0:1790772542.138328:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.138505:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796617856 00000100:00100000:0.0:1790772542.138526:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796617856 00000100:00100000:0.0:1790772542.138595:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1790772542.138606:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11582:x1877760796617856:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772542.138628:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772542.138632:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772542.138659:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be233c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b8f expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.138679:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:0.0:1790772542.138683:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772542.138696:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bb2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772542.139159:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1790772542.139332:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be23b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.139365:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.139374:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.139656:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb2 expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.139672:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be23b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb2 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.139680:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328946b8300) 00010000:00010000:0.0:1790772542.139683:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772542.139686:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92400, rc 0) 00000100:00100000:0.0:1790772542.139756:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11582:x1877760796617856:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1152us (1438us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1790772542.139763:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:3.0:1790772542.146258:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.146372:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796618112 00000100:00100000:2.0:1790772542.146395:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796618112 00000100:00100000:2.0:1790772542.146460:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:2.0:1790772542.146487:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11582:x1877760796618112:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.146594:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772542.146622:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be23b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb2 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146642:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328946b8300) 00010000:00010000:2.0:1790772542.146653:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772542.146676:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146690:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146699:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146713:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146720:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146726:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146798:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146806:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146824:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146831:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772542.146836:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146844:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146852:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:2.0:1790772542.146855:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772542.146859:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.146864:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147281:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147290:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147296:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147301:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772542.147304:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147323:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147333:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf27720f2 (ffff9328a1803e00) 00010000:00010000:2.0:1790772542.147335:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772542.147338:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.147343:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf27720f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772542.148352:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11582:x1877760796618112:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1858us (2095us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772542.148364:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:3.0:1790772542.158344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.158451:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796618240 00000100:00100000:2.0:1790772542.158462:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796618240 00000100:00100000:2.0:1790772542.158532:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:2.0:1790772542.158542:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+61:11582:x1877760796618240:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.158574:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772542.158596:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bb9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.158631:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.158644:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.158654:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.158755:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 63 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.158783:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.158792:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772542.158795:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772542.158798:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519c00, rc 0) 00000100:00100000:2.0:1790772542.158865:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11582:x1877760796618240:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 324us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.158926:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:1.0:1790772542.162631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.162844:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796618496 00000100:00100000:0.0:1790772542.162854:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796618496 00000100:00100000:0.0:1790772542.162958:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:0.0:1790772542.162969:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+62:11582:x1877760796618496:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772542.163056:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.163074:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.163107:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772542.163365:0:8380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1790772542.163377:0:8380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362983501038ns, next at 363983497453ns, rc = 0 00000004:00010000:0.0:1790772542.163466:0:8380:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089fb9ff7 reply state 0000000016e6ee7c transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.163475:0:8380:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772542.163626:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11582:x1877760796618496:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 656us (1005us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1790772542.163634:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00010000:00010000:0.0:1790772542.167195:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.167214:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.167222:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.167228:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772542.167233:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.167241:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.167257:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772542.167261:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772542.167281:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.167287:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92c00/0xd3c7635991be23dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.169724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.169837:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796618624 00000100:00100000:2.0:1790772542.169849:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796618624 00000100:00100000:2.0:1790772542.169944:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:2.0:1790772542.169955:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+63:11582:x1877760796618624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.169984:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772542.170005:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bc0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.170076:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 64 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.170090:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 64 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.170110:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772542.170113:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772542.170132:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881519600, rc 0) 00000100:00100000:2.0:1790772542.170204:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11582:x1877760796618624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 251us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.170213:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:3.0:1790772542.174160:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.174263:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796618752 00000100:00100000:2.0:1790772542.174273:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796618752 00000100:00100000:2.0:1790772542.174339:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1790772542.174349:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2354:x1877760796618752:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790772542.174680:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2354:x1877760796618752:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 331us (529us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1790772542.174688:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00080000:3.0:1790772542.175371:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772542.178210:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772542.178317:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796619008 00000100:00100000:3.0:1790772542.178327:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796619008 00000100:00100000:3.0:1790772542.178387:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1790772542.178398:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+64:11582:x1877760796619008:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790772542.178703:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+65:11582:x1877760796619008:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 305us (501us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1790772542.178711:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1790772542.183595:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.183911:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796619264 00000100:00100000:0.0:1790772542.183933:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796619264 00000100:00100000:0.0:1790772542.183998:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:0.0:1790772542.184011:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+65:11582:x1877760796619264:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772542.184135:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+65:11582:x1877760796619264:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 127us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.184143:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:1.0:1790772542.189274:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.189537:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796619392 00000100:00100000:2.0:1790772542.189548:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796619392 00000100:00100000:2.0:1790772542.189622:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:2.0:1790772542.189632:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+65:11582:x1877760796619392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.189656:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772542.189680:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be23eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bc7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.189757:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be23f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.189772:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be23f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.189786:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be23f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772542.189825:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772542.189865:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be23f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.189933:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518800/0xd3c7635991be23eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc7 expref: 67 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.189954:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be23f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc7 expref: 66 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.189962:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772542.189965:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790772542.189969:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932881518000, rc 0) 00000100:00100000:2.0:1790772542.190026:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+66:11582:x1877760796619392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 394us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.190034:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:1.0:1790772542.194049:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.194167:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796619520 00000100:00100000:2.0:1790772542.194180:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796619520 00000100:00100000:2.0:1790772542.194241:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1790772542.194253:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+10:2355:x1877760796619520:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.194279:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772542.194329:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772542.194365:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd053e, blocks: 0x1 00010000:00010000:2.0:1790772542.194389:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1790772542.194394:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772542.194407:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.194440:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.194455:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d600, rc 0) 00000100:00100000:2.0:1790772542.194529:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2355:x1877760796619520:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 277us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.194535:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1790772542.198669:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.199468:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796619776 00000100:00100000:0.0:1790772542.199480:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796619776 00000100:00100000:0.0:1790772542.199700:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:0.0:1790772542.199711:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+66:11582:x1877760796619776:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772542.199848:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+66:11582:x1877760796619776:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 138us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.199855:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:1.0:1790772542.203120:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.203310:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796619904 00000100:00100000:2.0:1790772542.203321:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796619904 00000100:00100000:2.0:1790772542.203382:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1790772542.203393:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:11582:x1877760796619904:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772542.203412:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772542.203431:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bd5 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.203463:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.203472:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772542.203477:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772542.203483:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.203535:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.203575:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772542.203590:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1877760813382656:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772542.203689:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328912ddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772542.206702:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1877760813382656:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772542.206744:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772542.206766:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d200, rc 0) 00000100:00100000:2.0:1790772542.206838:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:11582:x1877760796619904:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3445us (3725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.206848:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1790772542.210349:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.210454:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620032 00000100:00100000:0.0:1790772542.210468:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620032 00010000:00010000:0.0:1790772542.210539:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.210595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:0.0:1790772542.210605:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+12:2355:x1877760796620032:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772542.210642:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772542.210667:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.210682:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.210709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f5121a/0xd3c7635991be23f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bce expref: 12 pid: 6705 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.210726:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772542.210730:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772542.210738:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.210749:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.210792:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.210808:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5840:1877760813382784:192.168.201.34@tcp:105: 00000100:00100000:0.0:1790772542.210945:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886ceca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772542.218100:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.218267:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5840:1877760813382784:192.168.201.34@tcp:105: 00010000:00010000:0.0:1790772542.218294:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772542.218365:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2355:x1877760796620032:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 7760us (8029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.218378:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00010000:00010000:0.0:1790772542.219148:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772542.219525:0:6710:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620160 00000100:00100000:3.0:1790772542.219535:0:6710:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620160 00002000:00100000:3.0:1790772542.219593:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93288f0cce00 x1877760796620160/t0(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:133/0 lens 504/0 e 0 to 0 dl 1790772553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772542.219604:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93288f0cce00 with x1877760796620160 ext(0->12) 00002000:00010000:3.0:1790772542.219610:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93288f0cce00 00000100:00100000:3.0:1790772542.219634:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1790772542.219643:0:6710:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+11:2354:x1877760796620160:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790772542.220145:0:6710:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2354:x1877760796620160:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 499us (2057us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790772542.220154:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00002000:00100000:3.0:1790772542.220160:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93288f0cce00 x1877760796620160/t4294967320(0) o4->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:133/0 lens 504/448 e 0 to 0 dl 1790772553 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772542.220168:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93288f0cce00 with x1877760796620160 ext(0->12) 00002000:00010000:3.0:1790772542.220171:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93288f0cce00 00000100:00100000:1.0:1790772542.224104:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.224237:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620288 00000100:00100000:2.0:1790772542.224250:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620288 00000100:00100000:2.0:1790772542.224323:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:2.0:1790772542.224334:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+66:11582:x1877760796620288:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790772542.277746:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1790772542.277760:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1790772542.277837:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1790772542.277860:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9328883db0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1790772542.277866:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf580500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9328883dba80 00000020:00080000:3.0:1790772542.277869:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf580600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9328bf5ee400 00000004:00080000:3.0:1790772542.278154:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1790772542.278163:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9328883db3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1790772542.278166:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf580400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9328883db9c0 00000020:00080000:3.0:1790772542.278169:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328bf580900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9328b99f8400 00000001:00080000:3.0:1790772542.278178:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:3.0:1790772542.278218:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1790772542.278232:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790772542.278442:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790772542.278778:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772542.278802:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813382912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790772542.278870:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772542.279180:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813383040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790772542.279210:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772542.279242:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772542.279248:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813383168:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790772542.279270:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772542.279561:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11582:x1877760796620288:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 55219us (55459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.279574:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:1.0:1790772542.282501:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813382912 00000100:00100000:1.0:1790772542.282527:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813382912 00000100:00100000:1.0:1790772542.282726:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813383040 00000100:00100000:1.0:1790772542.282730:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813383040 00000100:00100000:1.0:1790772542.282746:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813383168 00000100:00100000:1.0:1790772542.282749:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813383168 00000100:00100000:1.0:1790772542.282769:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790772542.282779:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1877760813382912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790772542.282813:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1790772542.282842:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.282865:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.282985:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790772542.282991:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772542.282997:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283040:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283056:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 12 pid: 6704 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.283075:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813383296:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772542.283283:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9886480 going to sleep for 11 seconds 00000100:00080000:1.0:1790772542.283306:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772542.283324:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772542.283334:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1877760813383040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790772542.283544:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790772542.283548:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790772542 00002000:00010000:1.0:1790772542.283551:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790772542.283563:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790772542 -> 1790772542 00002000:00010000:1.0:1790772542.283566:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790772542.283635:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3317:x1877760813383040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 303us (4423us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1790772542.283643:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790772542.283665:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790772542.283673:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1877760813383168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790772542.283688:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1790772542.283710:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd053d, atime: 0x6abd053d, ctime: 0x6abd053d, blocks: 0x1 00010000:00010000:1.0:1790772542.283717:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283727:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1790772542.283731:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772542.283737:0:6706:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283752:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283777:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283786:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.283804:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790772542.284334:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3317:x1877760813383168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 661us (5060us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790772542.284343:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1790772542.284917:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772542.284927:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.284937:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772542.284941:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.284950:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.284968:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.284974:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b60f26bd/0xd3c7635991be240e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.284995:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772542.284997:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772542.284999:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790772542.285116:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93288f0cf800/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790772542.285124:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813383168:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1790772542.285139:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93288f34d880/2, rc 0, transno 4294967321 00000100:00100000:2.0:1790772542.285155:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813383040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790772542.286481:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.289424:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620416 00000100:00100000:2.0:1790772542.289441:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620416 00000100:00100000:2.0:1790772542.290043:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1790772542.290057:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+13:2357:x1877760796620416:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790772542.299151:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.299195:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620544 00000100:00100000:0.0:1790772542.299206:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620544 00010000:00010000:0.0:1790772542.299275:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 14 pid: 6704 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.299326:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1790772542.299339:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2355:x1877760796620544:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772542.299358:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772542.299365:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 14 pid: 6704 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.299382:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 14 pid: 6704 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.299410:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772542.299415:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772542.299421:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.299433:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.299455:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772542.299528:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+14:2355:x1877760796620544:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 190us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.299537:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00010000:00010000:3.0:1790772542.301090:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb4feaf/0xd3c7635991be21c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b34 expref: 13 pid: 6704 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772542.301115:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813383296:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772542.301146:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.301157:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.301165:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.301192:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.301200:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.301232:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790772542.301979:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1877760813382912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19198us (23105us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1790772542.301992:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1790772542.302055:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93288f34d500/2, rc 0, transno 4294967322 00000100:00100000:3.0:1790772542.302062:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813382912:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790772542.302397:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772542.302417:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.302429:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772542.302434:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.302446:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.302468:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.302474:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d19d49/0xd3c7635991be2407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.302517:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772542.302519:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772542.302520:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772542.333864:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1790772542.333990:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1790772542.334001:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1790772542.334198:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2357:x1877760796620416:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 44136us (47717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772542.334211:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1790772542.337460:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772542.337845:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620800 00000100:00100000:1.0:1790772542.337856:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620800 00000100:00100000:0.0:1790772542.338219:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:0.0:1790772542.338231:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11582:x1877760796620800:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772542.338290:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772542.338323:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518000/0xd3c7635991be23f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc7 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.338346:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772542.338352:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772542.338398:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.338414:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.338423:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772542.338815:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f398bb08 reply state 00000000a1940bf3 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.338826:0:5855:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772542.339241:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:11582:x1877760796620800:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 997us (1777us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1790772542.339250:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:2.0:1790772542.343535:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772542.343581:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796620928 00000100:00100000:2.0:1790772542.343593:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796620928 00000100:00100000:2.0:1790772542.343657:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:2.0:1790772542.343667:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796620928:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790772542.343934:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790772542.343938:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790772542 -> 1790772542 00002000:00010000:2.0:1790772542.343940:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790772541 00002000:00010000:2.0:1790772542.343943:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790772542 -> 1790772542 00002000:00010000:2.0:1790772542.343945:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790772542.344010:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796620928:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 343us (484us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1790772542.344017:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00010000:00010000:1.0:1790772542.344856:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.344871:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.344924:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.344931:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.344936:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.344965:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.344981:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772542.344983:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772542.344988:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.344994:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93800/0xd3c7635991be2415 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772542.348930:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.349043:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796621184 00000100:00100000:0.0:1790772542.349056:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796621184 00000100:00100000:0.0:1790772542.349116:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:0.0:1790772542.349128:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:11582:x1877760796621184:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790772542.349197:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.349215:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.349225:0:5857:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.349261:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.349296:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 20 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.349313:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813383424:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772542.349400:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886cec000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772542.354344:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772542.354442:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796621312 00000100:00100000:1.0:1790772542.354452:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796621312 00010000:00010000:1.0:1790772542.354515:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 21 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.354571:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:1.0:1790772542.354581:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:2354:x1877760796621312:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772542.354596:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772542.354603:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 21 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.354616:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 21 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.354638:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772542.354643:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.354673:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.354681:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.354699:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772542.354760:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:2354:x1877760796621312:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 181us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772542.354769:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00010000:00010000:0.0:1790772542.355378:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519c00/0xd3c7635991be23d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bb9 expref: 20 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.355399:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5857:1877760813383424:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772542.355420:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355428:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355435:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355465:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355473:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355480:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355496:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772542.355516:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355524:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355536:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772542.355539:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790772542.355542:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.355557:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be241c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.355622:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:11582:x1877760796621184:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 6495us (6752us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790772542.355631:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:2.0:1790772542.360362:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772542.360465:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796621440 00000100:00100000:3.0:1790772542.360477:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796621440 00000100:00100000:3.0:1790772542.360569:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1790772542.360579:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2355:x1877760796621440:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790772542.360629:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.360650:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.360677:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772542.360681:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772542.360686:0:6704:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.360722:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.360737:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 8 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772542.360753:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813383552:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772542.360837:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9886cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772542.364433:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1877760813383552:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772542.364481:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772542.367789:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.367927:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796621568 00000100:00100000:0.0:1790772542.367939:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796621568 00010000:00010000:0.0:1790772542.367978:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.368012:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1790772542.368021:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+9:2354:x1877760796621568:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772542.368037:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772542.368061:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.368075:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.368113:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d235e8c5/0xd3c7635991be2400 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bd5 expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.368128:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772542.368132:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772542.368139:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.368149:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.368242:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772542.368305:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2354:x1877760796621568:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 284us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.368314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00010000:00010000:3.0:1790772542.370410:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370436:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370483:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370503:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370545:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370563:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772542.370569:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370580:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370599:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.370607:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f169aea/0xd3c7635991be2423 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772542.370735:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2355:x1877760796621440:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 10152us (10380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772542.370745:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:2.0:1790772542.375788:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772542.375961:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796621824 00000100:00100000:1.0:1790772542.375975:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796621824 00000100:00100000:1.0:1790772542.376042:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:1.0:1790772542.376051:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:11582:x1877760796621824:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790772542.376142:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376163:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376176:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376372:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376395:0:8380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376405:0:8380:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376437:0:8380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.376451:0:8380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 20 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.376466:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813383680:192.168.201.34@tcp:104: 00000100:00100000:1.0:1790772542.377153:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328812ed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772542.380760:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.380866:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796621952 00000100:00100000:0.0:1790772542.380930:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796621952 00010000:00010000:0.0:1790772542.380977:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 21 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.381078:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1790772542.381089:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:2354:x1877760796621952:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772542.381107:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772542.381114:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 21 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.381143:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 21 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.381164:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772542.381170:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.381179:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.381186:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.381207:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772542.381255:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:2354:x1877760796621952:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 169us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.381263:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00010000:00010000:1.0:1790772542.381366:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519600/0xd3c7635991be23e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bc0 expref: 20 pid: 5856 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.381383:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813383680:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772542.381403:0:8380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.381411:0:8380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.381417:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772542.381994:0:8380:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1790772542.382146:0:8380:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1790772542.382193:0:8380:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1790772542.382272:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8380:1877760813383808:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790772542.382339:0:8380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772542.382383:0:5861:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813383808 00000100:00100000:1.0:1790772542.382389:0:5861:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813383808 00000100:00100000:1.0:1790772542.382432:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772542.382441:0:5861:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8380:x1877760813383808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790772542.382787:0:5861:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8380:x1877760813383808:12345-0@lo:1000:mdt00_003.0 Request processed in 347us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772542.382795:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772542.382826:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772542.382843:0:8380:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1790772542.382849:0:8380:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1790772542.382865:0:8380:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93288f34d880, transno 4294967321 00000100:00100000:1.0:1790772542.383002:0:8380:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93288f34d500 x1877760813382912/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790772558 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772542.383015:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8380:1877760813383808:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1790772542.383522:0:8380:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1790772542.384784:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8380:1877760813383936:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790772542.384846:0:8380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772542.385330:0:5861:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813383936 00000100:00100000:2.0:1790772542.385340:0:5861:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813383936 00000100:00100000:2.0:1790772542.385410:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772542.385419:0:5861:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8380:x1877760813383936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790772542.385674:0:5861:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8380:x1877760813383936:12345-0@lo:1000:mdt00_003.0 Request processed in 256us (827us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1790772542.385681:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772542.386064:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772542.386098:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8380:1877760813383936:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790772542.386138:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386150:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386167:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386173:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.386178:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386187:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386202:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772542.386205:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772542.386210:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386216:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2431 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386247:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386254:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386259:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386264:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881519800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.386267:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386285:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386295:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772542.386297:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772542.386305:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 23 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386316:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 23 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386325:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 23 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.386353:0:8380:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 23 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772542.386365:0:8380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bfdbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813384064:192.168.201.34@tcp:105: 00000100:00100000:1.0:1790772542.386426:0:8380:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289c75ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772542.392804:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772542.392926:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796622080 00000100:00100000:3.0:1790772542.392937:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796622080 00000100:00100000:3.0:1790772542.393046:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1790772542.393058:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11581:x1877760796622080:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:3.0:1790772542.393209:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+24:11581:x1877760796622080:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 152us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772542.393232:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1790772542.393526:0:8380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bfdbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8380:1877760813384064:192.168.201.34@tcp:105: 00010000:00010000:1.0:1790772542.393564:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393576:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881519800/0xd3c7635991be2374 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393609:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393632:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393644:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393655:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393662:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393669:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393675:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.393679:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393687:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393699:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772542.393702:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772542.393706:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393713:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2438 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393723:0:8380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393737:0:8380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393743:0:8380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393749:0:8380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dae00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772542.393751:0:8380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393757:0:8380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393765:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772542.393768:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772542.393771:0:8380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.393776:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be242a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772542.401099:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772542.401111:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772542.401705:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790772542.401715:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772542.401848:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:11582:x1877760796621824:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 25792us (26063us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1790772542.401862:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 229 00000020:00080000:1.0:1790772542.401869:0:8380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790772542.402418:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.412463:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796622336 00000100:00100000:0.0:1790772542.412481:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796622336 00000100:00100000:2.0:1790772542.412911:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:2.0:1790772542.412933:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:11581:x1877760796622336:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:2.0:1790772542.413357:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790772542.413458:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:11581:x1877760796622336:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 528us (11041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.413467:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:2.0:1790772542.418425:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.418559:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796622592 00000100:00100000:0.0:1790772542.418571:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796622592 00000100:00100000:0.0:1790772542.418634:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:0.0:1790772542.418645:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+23:11582:x1877760796622592:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790772542.419354:0:5859:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790772542.419465:0:5859:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1790772542.419524:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.419552:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.419565:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.419572:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.419578:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.419584:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.419609:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790772542.419709:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+25:11582:x1877760796622592:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1063us (1293us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790772542.419718:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000020:00080000:0.0:1790772542.419723:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772542.421363:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772542.421389:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.421400:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772542.421405:0:8521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.421414:0:8521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.421431:0:8521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9328946b8e00) 00010000:00010000:1.0:1790772542.421434:0:8521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790772542.421439:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.421446:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be243f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772542.421469:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772542.421471:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772542.421473:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772542.477737:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.478710:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796622720 00000100:00100000:0.0:1790772542.478723:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796622720 00000100:00100000:0.0:1790772542.478790:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:0.0:1790772542.478800:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+25:11584:x1877760796622720:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772542.478825:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772542.478848:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bdc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.478990:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479011:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479024:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479040:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479048:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479056:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479284:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479307:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479316:0:5855:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479351:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.479365:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 26 pid: 5855 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.479393:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813384192:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772542.479479:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886cec300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772542.489393:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5855:1877760813384192:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772542.489427:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772542.502747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.502857:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796622976 00000100:00100000:0.0:1790772542.502867:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796622976 00000100:00100000:0.0:1790772542.502972:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1790772542.502983:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:5593:x1877760796622976:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790772542.503235:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:5593:x1877760796622976:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 253us (499us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1790772542.503243:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1790772542.512205:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772542.512290:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796623104 00000100:00100000:0.0:1790772542.512301:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796623104 00010000:00010000:0.0:1790772542.512343:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 28 pid: 5855 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772542.512389:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:0.0:1790772542.512400:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:2355:x1877760796623104:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772542.512416:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772542.512423:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 28 pid: 5855 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.512455:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 28 pid: 5855 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.512478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932881518a00/0xd3c7635991be2366 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b9d expref: 28 pid: 5855 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.512514:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772542.512520:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.512528:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.512536:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772542.512708:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772542.512775:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+27:2355:x1877760796623104:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 375us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772542.512783:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00010000:00010000:3.0:1790772542.512909:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.512919:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772542.512963:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790772542.512968:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772542.512989:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513003:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513012:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513018:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513025:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513031:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772542.513036:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513043:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513063:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:3.0:1790772542.513067:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772542.513071:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513077:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93400/0xd3c7635991be244d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513090:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513097:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513103:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513109:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772542.513112:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513118:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513126:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9328946b8800) 00010000:00010000:3.0:1790772542.513128:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772542.513131:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513137:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92a00/0xd3c7635991be2454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513186:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93600/0xd3c7635991be2446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bdc expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513201:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bdc expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772542.513208:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:3.0:1790772542.513210:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772542.513212:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93c00, rc 0) 00000100:00100000:3.0:1790772542.513242:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11584:x1877760796622720:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 34443us (35514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772542.513249:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:2.0:1790772542.667042:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772542.667070:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813384320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772542.667148:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772542.667708:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813384320 00000100:00100000:2.0:1790772542.667717:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813384320 00000100:00100000:2.0:1790772542.667821:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790772542.667832:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1877760813384320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772542.667860:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772542.667946:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1877760813384320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772542.667953:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772542.669573:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813384320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772543.251686:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772543.435723:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772543.435734:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772543.435772:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790772543.435780:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772543.435942:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813384448:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772543.436040:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328912dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772543.446980:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772543.451312:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11699:1877760813384448:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772543.451648:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796623232 00000100:00100000:3.0:1790772543.451657:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796623232 00000100:00100000:3.0:1790772543.451718:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:3.0:1790772543.451728:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11595:x1877760796623232:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772543.451763:0:5856:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790772543.451869:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11595:x1877760796623232:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 141us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772543.451895:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:1.0:1790772543.477309:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772543.479834:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796623488 00000100:00100000:0.0:1790772543.479849:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796623488 00000100:00100000:0.0:1790772543.479924:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:0.0:1790772543.479934:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+26:11595:x1877760796623488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772543.479955:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772543.479993:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2462 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50be3 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772543.480101:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772543.480116:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772543.480128:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772543.480140:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790772543.480283:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93a00/0xd3c7635991be2462 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50be3 expref: 29 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772543.480302:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50be3 expref: 28 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772543.480311:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:0.0:1790772543.480314:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772543.480317:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92400, rc 0) 00000100:00100000:0.0:1790772543.480391:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:11595:x1877760796623488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 458us (3091us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1790772543.480398:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:3.0:1790772543.488953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772543.489015:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796623744 00000100:00100000:2.0:1790772543.489027:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796623744 00000100:00100000:3.0:1790772543.489036:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772543.489097:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:2.0:1790772543.489107:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:11595:x1877760796623744:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772543.489183:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.489200:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.489212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490222:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490238:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490246:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490252:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772543.490265:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490273:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490287:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:2.0:1790772543.490290:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772543.490295:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772543.490302:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c400/0xd3c7635991be2477 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772543.491286:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:11595:x1877760796623744:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 2173us (2336us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1790772543.491298:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:1.0:1790772543.494102:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796623872 00000100:00100000:1.0:1790772543.494121:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796623872 00000100:00100000:1.0:1790772543.494221:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1790772543.494231:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:2355:x1877760796623872:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772543.494249:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772543.494275:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92400/0xd3c7635991be2469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50be3 expref: 29 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.494293:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772543.494305:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772543.494371:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:2355:x1877760796623872:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 141us (5333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772543.494380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000040:00080000:2.0:1790772543.499028:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772543.499037:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772543.499763:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790772543.499775:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790772543.510787:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772543.512135:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796624128 00000100:00100000:1.0:1790772543.512150:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796624128 00000100:00100000:1.0:1790772543.512219:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1790772543.512230:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+28:11595:x1877760796624128:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772543.512477:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:11595:x1877760796624128:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 248us (1699us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790772543.512498:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000040:00080000:2.0:1790772543.523768:0:12526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772543.523777:0:12526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772543.523818:0:12526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790772543.523823:0:12526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772543.830031:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772543.830068:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796624384 00000100:00100000:1.0:1790772543.830078:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796624384 00000100:00100000:1.0:1790772543.830128:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:1.0:1790772543.830139:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+29:11608:x1877760796624384:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772543.830164:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772543.830186:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be247e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bea expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.830285:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2485 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.830300:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.830312:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772543.830343:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790772543.830476:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be247e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bea expref: 32 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.830507:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bea expref: 31 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.830515:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772543.830517:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772543.830520:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db000, rc 0) 00000100:00100000:1.0:1790772543.830574:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:11608:x1877760796624384:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 437us (553us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790772543.830581:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:1.0:1790772543.849464:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772543.849515:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796624512 00000100:00100000:1.0:1790772543.849526:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796624512 00000100:00100000:1.0:1790772543.849587:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:1.0:1790772543.849597:0:5857:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:11608:x1877760796624512:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1790772543.849671:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849689:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849701:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849727:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849744:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849751:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849757:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dac00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772543.849761:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849769:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849782:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772543.849785:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772543.849789:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772543.849795:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dac00/0xd3c7635991be2493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772543.849866:0:5857:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:11608:x1877760796624512:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 271us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772543.849906:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:1.0:1790772544.020046:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772544.020165:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796624640 00000100:00100000:2.0:1790772544.020175:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796624640 00000100:00100000:2.0:1790772544.020255:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:2.0:1790772544.020267:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2356:x1877760796624640:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1790772544.020285:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772544.020321:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028843db6/0xd3c7635991be249a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bf1 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772544.020350:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abd053e, atime: 0x6abd053d, ctime: 0x6abd053e, blocks: 0xb 00010000:00010000:2.0:1790772544.020369:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1790772544.020374:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772544.020383:0:6705:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028843db6/0xd3c7635991be249a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bf1 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772544.020401:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028843db6/0xd3c7635991be249a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bf1 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772544.020414:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974c400, rc 0) 00000100:00100000:2.0:1790772544.020496:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2356:x1877760796624640:12345-192.168.201.34@tcp:101:cat.0 Request processed in 231us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.020504:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00080000:1.0:1790772544.020576:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772544.046989:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772544.047081:0:6709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796624768 00000100:00100000:0.0:1790772544.047090:0:6709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796624768 00002000:00100000:0.0:1790772544.047135:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9328c1183480 x1877760796624768/t0(0) o3->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:135/0 lens 488/0 e 0 to 0 dl 1790772555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772544.047176:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c1183480 with x1877760796624768 ext(0->4095) 00002000:00010000:0.0:1790772544.047182:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c1183480 00000100:00100000:0.0:1790772544.047213:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1790772544.047222:0:6709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2357:x1877760796624768:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:0.0:1790772544.047423:0:6709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+8:2357:x1877760796624768:12345-192.168.201.34@tcp:3:cat.0 Request processed in 201us (442us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790772544.047430:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00002000:00100000:0.0:1790772544.047437:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9328c1183480 x1877760796624768/t0(0) o3->0b5c3fb5-9865-4bac-a94a-29cd3a5b6677@192.168.201.34@tcp:135/0 lens 488/4536 e 0 to 0 dl 1790772555 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772544.047445:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328c1183480 with x1877760796624768 ext(0->4095) 00002000:00010000:0.0:1790772544.047449:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328c1183480 00000100:00100000:1.0:1790772544.206281:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813384832:0@lo:400:kworker.0 00000100:00100000:1.0:1790772544.206367:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772544.206447:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772544.206454:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813384704:0@lo:400:kworker.0 00000100:00100000:1.0:1790772544.206491:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772544.206512:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813385216:0@lo:400:kworker.0 00000100:00100000:0.0:1790772544.206702:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813384832 00000100:00100000:0.0:1790772544.206712:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813384832 00000100:00100000:0.0:1790772544.206760:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813384704 00000100:00100000:0.0:1790772544.206764:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813384704 00000100:00100000:0.0:1790772544.206784:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790772544.206793:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813384832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772544.206866:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813384832:12345-0@lo:400:kworker.0 Request processed in 73us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772544.206899:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790772544.206930:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790772544.206937:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813384704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772544.206981:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813384704:12345-0@lo:400:kworker.0 Request processed in 45us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772544.206999:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1790772544.207031:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772544.207408:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813384576:0@lo:400:kworker.0 00000100:00100000:3.0:1790772544.207453:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772544.207508:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813385088:0@lo:400:kworker.0 00000100:00100000:3.0:1790772544.207542:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772544.207562:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772544.207568:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813384960:0@lo:400:kworker.0 00000100:00100000:3.0:1790772544.207593:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772544.207633:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813384960 00000100:00100000:3.0:1790772544.207637:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813384960 00000100:00100000:3.0:1790772544.207673:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790772544.207680:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1877760813384960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772544.207719:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1877760813384960:12345-0@lo:400:kworker.0 Request processed in 39us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772544.207725:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1790772544.207742:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772544.207769:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813384960:0@lo:400:kworker.0 00000100:00100000:1.0:1790772544.208204:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772544.208244:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813384832:0@lo:400:kworker.0 00000100:00100000:1.0:1790772544.208265:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813384704:0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.208394:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385216 00000100:00100000:2.0:1790772544.208399:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385216 00000100:00100000:2.0:1790772544.208448:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790772544.208456:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1877760813385216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772544.208509:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1877760813385216:12345-0@lo:400:kworker.0 Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.208527:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790772544.208645:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813385216:0@lo:400:kworker.0 00000100:00080000:3.0:1790772544.209950:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772544.210420:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813384576 00000100:00100000:0.0:1790772544.210432:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813384576 00000100:00100000:0.0:1790772544.210511:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790772544.210533:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813384576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772544.210640:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813384576:12345-0@lo:400:kworker.0 Request processed in 120us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772544.210648:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790772544.210693:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385088 00000100:00100000:0.0:1790772544.210697:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385088 00000100:00100000:0.0:1790772544.210748:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790772544.210755:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813385088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772544.210793:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813385088:12345-0@lo:400:kworker.0 Request processed in 38us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772544.210812:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1790772544.211102:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772544.211557:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813384576:0@lo:400:kworker.0 00000100:00100000:3.0:1790772544.211574:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813385088:0@lo:400:kworker.0 00010000:00010000:0.0:1790772544.267120:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772544.629697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772544.629772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772544.629811:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772544.630044:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625152 00000100:00100000:1.0:1790772544.630058:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625152 00000100:00100000:1.0:1790772544.630145:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:1.0:1790772544.630171:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2356:x1877760796625152:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772544.630282:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2356:x1877760796625152:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 115us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772544.630291:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:2.0:1790772544.631101:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796624896 00000100:00100000:2.0:1790772544.631109:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796624896 00000100:00100000:2.0:1790772544.631173:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 301 00000100:00100000:2.0:1790772544.631203:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796624896:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772544.631265:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796624896:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 64us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.631272:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 301 00000100:00080000:2.0:1790772544.631310:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772544.631628:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772544.645701:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625024 00000100:00100000:0.0:1790772544.645726:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625024 00000100:00080000:2.0:1790772544.645897:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772544.646025:0:5857:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625280 00000100:00100000:0.0:1790772544.646031:0:5857:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625280 00000100:00100000:1.0:1790772544.646127:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:1.0:1790772544.646144:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:2356:x1877760796625024:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772544.646273:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+31:2356:x1877760796625024:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 133us (16459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772544.646282:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:1.0:1790772544.646304:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00080000:2.0:1790772544.646645:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772544.650600:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796625280:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772544.650774:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2356:x1877760796625280:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 4454us (19138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772544.650807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:3.0:1790772544.716783:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813385344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772544.717384:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772544.718020:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385344 00000100:00100000:2.0:1790772544.718034:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385344 00000100:00100000:2.0:1790772544.718113:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790772544.718124:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1877760813385344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772544.719509:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772544.719802:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1877760813385344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1676us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772544.719814:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772544.726126:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813385344:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1790772544.846407:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1790772544.846431:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1790772544.846438:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1790772545.293335:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772546.315123:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772547.354851:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772547.413919:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1790772547.414381:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790772547.414394:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93289c75cc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790772547.414400:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328c11a7800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93289c75c540 00000020:00080000:3.0:1790772547.414404:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328c11a7100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9328c0e56000 00000020:00080000:3.0:1790772547.414446:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1790772547.416860:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1790772547.417301:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000040:00080000:0.0:1790772547.596285:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772547.596294:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772547.596343:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790772547.596348:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772547.787699:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813385472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772547.787778:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772547.787961:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385472 00000100:00100000:1.0:1790772547.787970:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385472 00000100:00100000:1.0:1790772547.788019:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772547.788028:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813385472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772547.788065:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772547.788109:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813385472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772547.788116:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790772547.788137:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772547.788159:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790772547.788163:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328c0e48700, transno 4294967307 00000004:00080000:1.0:1790772547.788172:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1790772547.788188:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93288f0cf800, transno 4294967310 00000100:00100000:1.0:1790772547.788199:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813385472:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1790772547.860369:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1790772547.860387:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1790772548.365598:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772549.323280:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772549.323315:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813385984:0@lo:400:kworker.0 00000100:00100000:1.0:1790772549.323327:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813385728:0@lo:400:kworker.0 00000100:00100000:3.0:1790772549.324225:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813386112:0@lo:400:kworker.0 00000100:00100000:2.0:1790772549.324699:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772549.324958:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813385600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772549.324996:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772549.325290:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385984 00000100:00100000:0.0:1790772549.325312:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385984 00000100:00100000:0.0:1790772549.325399:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790772549.325411:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813385984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772549.325490:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813385984:12345-0@lo:400:kworker.0 Request processed in 81us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772549.325498:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790772549.325560:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813385984:0@lo:400:kworker.0 00000100:00100000:0.0:1790772549.326033:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385600 00000100:00100000:0.0:1790772549.326040:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385600 00000100:00100000:0.0:1790772549.326075:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790772549.326082:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813385600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772549.326131:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813385600:12345-0@lo:400:kworker.0 Request processed in 49us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772549.326137:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790772549.326188:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813385856:0@lo:400:kworker.0 00000100:00100000:0.0:1790772549.326222:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772549.326278:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813385600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772549.330280:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385856 00000100:00100000:2.0:1790772549.330303:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385856 00000100:00100000:2.0:1790772549.330409:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790772549.330427:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813385856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772549.330591:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1877760813385856:12345-0@lo:400:kworker.0 Request processed in 171us (4366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772549.330600:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790772549.330677:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1877760813385856:0@lo:400:kworker.0 00000100:00100000:1.0:1790772549.334373:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772549.336645:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813386240:0@lo:400:kworker.0 00000100:00100000:1.0:1790772549.336733:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772549.336814:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772549.336822:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772549.336841:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813385728 00000100:00100000:1.0:1790772549.336851:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813385728 00000100:00100000:1.0:1790772549.336931:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790772549.336941:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813385728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772549.337014:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813385728:12345-0@lo:400:kworker.0 Request processed in 74us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772549.337022:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790772549.338161:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772549.338210:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813385728:0@lo:400:kworker.0 00000100:00100000:2.0:1790772549.338406:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386112 00000100:00100000:2.0:1790772549.338414:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386112 00000100:00100000:0.0:1790772549.338470:0:6706:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386240 00000100:00100000:2.0:1790772549.338471:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790772549.338476:0:6706:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386240 00000100:00100000:2.0:1790772549.338480:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772549.338507:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790772549.338515:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813386240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772549.338534:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813386112:12345-0@lo:400:kworker.0 Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772549.338541:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790772549.338554:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813386240:12345-0@lo:400:kworker.0 Request processed in 41us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772549.338560:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790772549.338654:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813386112:0@lo:400:kworker.0 00000100:00080000:1.0:1790772549.340135:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772549.340145:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772549.340200:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1790772549.340207:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93288f34d500, transno 4294967322 00000004:00080000:1.0:1790772549.340224:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1790772549.340250:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813386240:0@lo:400:kworker.0 00010000:00010000:1.0:1790772549.387679:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772549.742393:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772549.742457:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625408 00000100:00100000:2.0:1790772549.742475:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625408 00000100:00080000:1.0:1790772549.742573:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772549.742576:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:2.0:1790772549.742589:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11269:x1877760796625408:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790772549.742749:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11269:x1877760796625408:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 162us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772549.742757:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:2.0:1790772549.748508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772549.748589:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625664 00000100:00100000:1.0:1790772549.748603:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625664 00000100:00100000:1.0:1790772549.748680:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1790772549.748692:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:11269:x1877760796625664:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772549.749201:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:11269:x1877760796625664:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 508us (706us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790772549.749211:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:2.0:1790772549.775440:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772549.775490:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772549.775526:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772549.775541:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625792 00000100:00100000:1.0:1790772549.775557:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625792 00000100:00100000:2.0:1790772549.775574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772549.775651:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 303 00000100:00100000:1.0:1790772549.775663:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796625792:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772549.775764:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796625792:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772549.775772:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 303 00000100:00100000:3.0:1790772549.776102:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626176 00000100:00100000:3.0:1790772549.776108:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626176 00000100:00100000:3.0:1790772549.776173:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:3.0:1790772549.776181:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796626176:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772549.776224:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2355:x1877760796626176:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 44us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772549.776229:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:0.0:1790772549.776311:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796625920 00000100:00100000:0.0:1790772549.776317:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796625920 00000100:00080000:2.0:1790772549.776321:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772549.776343:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772549.776374:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626048 00000100:00100000:0.0:1790772549.776387:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626048 00000100:00100000:0.0:1790772549.776435:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:0.0:1790772549.776444:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796625920:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772549.776477:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2355:x1877760796625920:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772549.776482:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:2.0:1790772549.776498:0:6706:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796626048:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:3.0:1790772549.776517:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772549.776532:0:6706:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796626048:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772549.781733:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:2.0:1790772549.783951:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:1.0:1790772549.835217:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772549.835252:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813386368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772549.835353:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772549.835692:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386368 00000100:00100000:0.0:1790772549.835705:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386368 00000100:00100000:0.0:1790772549.835792:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790772549.835804:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813386368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772549.835859:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772549.835967:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813386368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772549.835976:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790772549.836153:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813386368:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772550.413598:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772551.436832:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772551.689819:0:12730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:49:10 (1790772550) 00000001:00080000:2.0:1790772552.435407:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1790772552.435425:0:5878:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1790772552.435441:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1790772552.435453:0:5889:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790772552.459135:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772552.909380:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813386496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772552.909466:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772552.909736:0:6708:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386496 00000100:00100000:0.0:1790772552.909746:0:6708:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386496 00000100:00100000:0.0:1790772552.909822:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772552.909833:0:6708:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813386496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772552.909904:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772552.909958:0:6708:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813386496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772552.909965:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772552.910015:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328831c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813386496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772552.910195:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790772553.483220:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772554.444091:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813387008:0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.444184:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772554.444441:0:6704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387008 00000100:00100000:1.0:1790772554.444451:0:6704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387008 00000100:00100000:1.0:1790772554.444511:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790772554.444521:0:6704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813387008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772554.444571:0:6704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813387008:12345-0@lo:400:kworker.0 Request processed in 52us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772554.444578:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1790772554.444599:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772554.447538:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b8d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813387008:0@lo:400:kworker.0 00000100:00100000:3.0:1790772554.447569:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813386624:0@lo:400:kworker.0 00000100:00100000:3.0:1790772554.447705:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772554.447775:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813387136:0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.447783:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386624 00000100:00100000:0.0:1790772554.447794:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386624 00000100:00100000:3.0:1790772554.447815:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772554.447870:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790772554.447915:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813386752:0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.447928:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813386624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.448023:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813386624:12345-0@lo:400:kworker.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772554.448030:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790772554.448165:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772554.448204:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813387264:0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.448223:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387136 00000100:00100000:0.0:1790772554.448230:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387136 00000100:00100000:3.0:1790772554.448238:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772554.448280:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386752 00000100:00100000:0.0:1790772554.448285:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386752 00000100:00100000:0.0:1790772554.448316:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790772554.448323:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813387136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772554.448420:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772554.448431:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813386880:0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.449512:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813387136:12345-0@lo:400:kworker.0 Request processed in 1183us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772554.449525:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790772554.449560:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790772554.449570:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813386752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.449622:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813386752:12345-0@lo:400:kworker.0 Request processed in 54us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772554.449628:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1790772554.449651:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772554.450378:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387264 00000100:00100000:2.0:1790772554.450396:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387264 00000100:00080000:0.0:1790772554.450467:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772554.450636:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790772554.450663:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813387264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772554.450774:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813387264:12345-0@lo:400:kworker.0 Request processed in 126us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772554.450783:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790772554.450859:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813386624:0@lo:400:kworker.0 00000100:00100000:2.0:1790772554.450914:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813387136:0@lo:400:kworker.0 00000100:00100000:3.0:1790772554.453836:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772554.453986:0:5856:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813386880 00000100:00100000:0.0:1790772554.454005:0:5856:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813386880 00000100:00100000:0.0:1790772554.454085:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790772554.454096:0:5856:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813386880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772554.454587:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813386752:0@lo:400:kworker.0 00000100:00100000:0.0:1790772554.455175:0:5856:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813386880:12345-0@lo:400:kworker.0 Request processed in 1074us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772554.455190:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1790772554.455233:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772554.459583:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813387264:0@lo:400:kworker.0 00000100:00100000:3.0:1790772554.460039:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813386880:0@lo:400:kworker.0 00010000:00010000:1.0:1790772554.507160:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772554.759371:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772554.759479:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626304 00000100:00100000:3.0:1790772554.759491:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626304 00000100:00100000:3.0:1790772554.759577:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:3.0:1790772554.759587:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:12273:x1877760796626304:12345-192.168.201.34@tcp:101:lsof.0 00010000:00010000:3.0:1790772554.759608:0:8380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772554.759630:0:8380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be24a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50bf8 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772554.759710:0:8380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be24a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772554.759725:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be24a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772554.759754:0:8380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be24a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772554.759808:0:8380:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772554.759812:0:8380:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772554.759857:0:8380:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be24a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772554.759914:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9200/0xd3c7635991be24a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bf8 expref: 7 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772554.759934:0:8380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be24a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bf8 expref: 6 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772554.759944:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:3.0:1790772554.759947:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772554.759950:0:8380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8200, rc 0) 00000100:00100000:3.0:1790772554.760018:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:12273:x1877760796626304:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 432us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772554.760026:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00080000:0.0:1790772554.760336:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772554.873140:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772554.873198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772554.873237:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772554.873296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772554.873338:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626688 00000100:00100000:1.0:1790772554.873349:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626688 00000100:00100000:0.0:1790772554.873530:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626560 00000100:00100000:0.0:1790772554.873536:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626560 00000100:00100000:0.0:1790772554.873597:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:0.0:1790772554.873608:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:2354:x1877760796626560:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772554.873717:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:2354:x1877760796626560:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 111us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772554.873724:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00080000:0.0:1790772554.873761:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772554.873993:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626816 00000100:00100000:1.0:1790772554.874012:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626816 00000100:00100000:1.0:1790772554.874036:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:1.0:1790772554.874043:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796626688:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772554.874072:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2354:x1877760796626688:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772554.874079:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:1.0:1790772554.874092:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:1.0:1790772554.874098:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328831c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796626816:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772554.874127:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328831c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2354:x1877760796626816:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772554.874132:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00080000:0.0:1790772554.874273:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772554.874276:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772554.874495:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796626432 00000100:00100000:2.0:1790772554.874501:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796626432 00000100:00100000:2.0:1790772554.874540:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 305 00000100:00100000:2.0:1790772554.874547:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796626432:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772554.874574:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2354:x1877760796626432:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772554.874587:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 305 00000100:00100000:3.0:1790772554.957974:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813387392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772554.958067:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772554.958792:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387392 00000100:00100000:1.0:1790772554.958810:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387392 00000100:00100000:1.0:1790772554.958943:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772554.958960:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813387392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772554.959017:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772554.959124:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813387392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772554.959133:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790772554.959582:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813387392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772555.531314:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772556.556455:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772557.148781:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772557.148901:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796627072 00000100:00100000:3.0:1790772557.148911:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796627072 00000100:00100000:3.0:1790772557.148987:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1790772557.148999:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+18:12274:x1877760796627072:12345-192.168.201.34@tcp:35:umount.0 00000100:00080000:0.0:1790772557.149399:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772557.149671:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:12274:x1877760796627072:12345-192.168.201.34@tcp:35:umount.0 Request processed in 672us (898us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790772557.149679:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1790772557.153511:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772557.153669:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796627328 00000100:00100000:1.0:1790772557.153680:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796627328 00000100:00100000:1.0:1790772557.153736:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:1.0:1790772557.153744:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+19:12274:x1877760796627328:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:1.0:1790772557.154159:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:12274:x1877760796627328:12345-192.168.201.34@tcp:35:umount.0 Request processed in 413us (656us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790772557.154167:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:1.0:1790772557.156038:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772557.156138:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796627584 00000100:00100000:0.0:1790772557.156147:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796627584 00000100:00100000:0.0:1790772557.156205:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1790772557.156215:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328848b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+20:12274:x1877760796627584:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:0.0:1790772557.156478:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328848b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:12274:x1877760796627584:12345-192.168.201.34@tcp:35:umount.0 Request processed in 263us (446us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790772557.156486:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1790772557.162232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772557.162350:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796627840 00000100:00100000:0.0:1790772557.162361:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796627840 00000100:00100000:0.0:1790772557.162445:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1790772557.162455:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:12274:x1877760796627840:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:0.0:1790772557.162814:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:12274:x1877760796627840:12345-192.168.201.34@tcp:35:umount.0 Request processed in 359us (591us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1790772557.162847:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:2.0:1790772557.168987:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772557.169027:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772557.169065:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772557.169161:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796628480 00000100:00100000:3.0:1790772557.169173:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796628480 00000100:00100000:3.0:1790772557.169246:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:3.0:1790772557.169264:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+7:2353:x1877760796628480:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:3.0:1790772557.169312:0:12032:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1a67 00000020:00010000:3.0:1790772557.169321:0:12032:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93288694f000: total 0 00000100:00080000:3.0:1790772557.169326:0:12032:0:(import.c:65:import_set_state_nolock()) ffff93288694a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772557.169362:0:12032:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1790772557.169644:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2353:x1877760796628480:12345-192.168.201.34@tcp:9:umount.0 Request processed in 380us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772557.169652:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00080000:2.0:1790772557.169834:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772557.170058:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796627968 00000100:00100000:1.0:1790772557.170064:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796627968 00000100:00100000:1.0:1790772557.170106:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796628096 00000100:00100000:1.0:1790772557.170109:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796628096 00000100:00100000:1.0:1790772557.170137:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1790772557.170144:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+14:2356:x1877760796627968:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772557.170157:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772557.170175:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9000/0xd3c7635991be152e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5078a expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.170189:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772557.170218:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+13:2356:x1877760796627968:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 75us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772557.170225:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1790772557.170240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1790772557.170246:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:2356:x1877760796628096:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772557.170268:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772557.170276:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881680a00/0xd3c7635991be1494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50752 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.170291:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772557.170309:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2356:x1877760796628096:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 63us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772557.170330:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000020:00010000:1.0:1790772557.170352:0:8521:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93288694f000: total 0 00010000:00010000:1.0:1790772557.170381:0:8521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93288694f000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790772557.170425:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009322c8a6/0xd3c7635991be1e0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a2a expref: 4 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.170458:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028843db6/0xd3c7635991be249a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bf1 expref: 3 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.170473:0:8521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93288694f000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790772557.170484:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772557.170486:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772557.170487:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772557.171317:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772557.171675:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796628608 00000100:00100000:1.0:1790772557.171684:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796628608 00000100:00100000:1.0:1790772557.171733:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1790772557.171741:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2357:x1877760796628608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772557.171753:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772557.171767:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9800/0xd3c7635991be1718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50855 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.171781:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772557.171831:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+10:2357:x1877760796628608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 90us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772557.171838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1790772557.179401:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772557.180487:0:6705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796628736 00000100:00100000:0.0:1790772557.180501:0:6705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796628736 00000100:00100000:0.0:1790772557.180577:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:0.0:1790772557.180589:0:6705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+5:2353:x1877760796628736:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:0.0:1790772557.180627:0:6705:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1806 00000100:00080000:0.0:1790772557.180637:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9328bf6ce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772557.180677:0:6705:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790772557.181027:0:6705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+2:2353:x1877760796628736:12345-192.168.201.34@tcp:9:umount.0 Request processed in 438us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772557.181035:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00010000:00010000:1.0:1790772557.181438:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772557.181781:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772557.191679:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772557.191781:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796629760 00000100:00100000:3.0:1790772557.191792:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796629760 00000100:00100000:3.0:1790772557.191857:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:3.0:1790772557.191868:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+22:2353:x1877760796629760:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:3.0:1790772557.191933:0:8380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be14a2 00000020:00010000:3.0:1790772557.191949:0:8380:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9328bfb08000: total 0 00000100:00080000:3.0:1790772557.191954:0:8380:0:(import.c:65:import_set_state_nolock()) ffff9328bfb09800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772557.191983:0:8380:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1790772557.192420:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b5c3fb5-9865-4bac-a94a-29cd3a5b6677+21:2353:x1877760796629760:12345-192.168.201.34@tcp:39:umount.0 Request processed in 551us (749us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1790772557.192429:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 239 00000020:00010000:1.0:1790772557.192605:0:5844:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9328bfb08000: total 0 00010000:00010000:1.0:1790772557.192664:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9328bfb08000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790772557.192701:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772557.192705:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772557.192715:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db200/0xd3c7635991be1ceb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a509dd expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192736:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772557.192739:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790772557.192744:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92e00/0xd3c7635991be17dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5087f expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192758:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772557.192760:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772557.192764:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db000/0xd3c7635991be2485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bea expref: 18 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192777:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772557.192780:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790772557.192784:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92600/0xd3c7635991be1e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a46 expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192794:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9328a16c3d00) 00010000:00010000:1.0:1790772557.192796:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772557.192800:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da200/0xd3c7635991be1788 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5086a expref: 16 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192816:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9328829d4400) 00010000:00010000:1.0:1790772557.192818:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772557.192840:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4da800/0xd3c7635991be2159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50b18 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192865:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772557.192868:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772557.192872:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932880030800/0xd3c7635991be237b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ba4 expref: 14 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192930:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772557.192933:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772557.192937:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92200/0xd3c7635991be1dcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a15 expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192948:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9328946b8f00) 00010000:00010000:1.0:1790772557.192950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772557.192954:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be1df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a23 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192967:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9328a16c3a00) 00010000:00010000:1.0:1790772557.192970:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772557.192973:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93c00/0xd3c7635991be245b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bdc expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.192985:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:1.0:1790772557.192987:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772557.192991:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed93e00/0xd3c7635991be1e5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50a3f expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.193001:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9328946b8a00) 00010000:00010000:1.0:1790772557.193010:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772557.193015:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be1ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50951 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.193031:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9328946b8100) 00010000:00010000:1.0:1790772557.193033:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772557.193037:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93289ed92000/0xd3c7635991be176c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50863 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772557.193052:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9328bfb08000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790772557.193065:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772557.193067:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772557.193069:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790772557.578802:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1790772557.578829:0:5878:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000001:00080000:1.0:1790772557.578835:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1790772557.578840:0:5878:0:(genops.c:885:class_export_put()) final put ffff9328bfb08000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:0.0:1790772557.578988:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bfb08000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 for lustre-MDT0000 00000020:00000080:0.0:1790772557.579054:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bfb09800 for lustre-MDT0000 00010000:00010000:1.0:1790772557.579142:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772557.835261:0:11699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772557.835272:0:11699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772557.835819:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790772557.835828:0:11699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772558.039100:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772558.039127:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813387520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772558.039207:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772558.039920:0:7727:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387520 00000100:00100000:0.0:1790772558.039930:0:7727:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387520 00000100:00100000:0.0:1790772558.039997:0:7727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790772558.040008:0:7727:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813387520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772558.040046:0:7727:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772558.040120:0:7727:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813387520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772558.040129:0:7727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790772558.040193:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813387520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772558.040222:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1790772558.131926:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:3.0:1790772558.131953:0:7658:0:(genops.c:885:class_export_put()) final put ffff93288694f000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:2.0:1790772558.132076:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93288694f000/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 for lustre-OST0001 00000020:00000080:2.0:1790772558.132129:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288694a800 for lustre-OST0001 00010000:00010000:1.0:1790772558.603962:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772559.257616:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772559.257669:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772559.257709:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772559.257811:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796629888 00000100:00100000:2.0:1790772559.257824:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796629888 00000100:00100000:2.0:1790772559.257920:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796630144 00000100:00100000:2.0:1790772559.257924:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796630144 00000100:00100000:2.0:1790772559.257938:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796630016 00000100:00100000:2.0:1790772559.257941:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796630016 00000100:00100000:2.0:1790772559.257957:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1790772559.257966:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+12:2357:x1877760796629888:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772559.257982:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772559.258003:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12be000/0xd3c7635991be1574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5079f expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772559.258027:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772559.258059:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1790772559.258083:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2357:x1877760796630144:12345-192.168.201.34@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790772559.258095:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+11:2357:x1877760796629888:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 120us (480us total) trans 0 rc 0/0 00010000:00010000:1.0:1790772559.258110:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790772559.258129:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:1.0:1790772559.258135:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881518c00/0xd3c7635991be1711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a5084e expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772559.258164:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:1.0:1790772559.258180:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772559.258185:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932886c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+9:2357:x1877760796630016:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772559.258201:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772559.258229:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12be400/0xd3c7635991be157b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a507c9 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772559.258244:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772559.258251:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:2357:x1877760796630144:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 176us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772559.258281:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932886c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+8:2357:x1877760796630016:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 101us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772559.258291:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1790772559.258334:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1790772559.266841:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772559.267476:0:5855:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796630400 00000100:00100000:0.0:1790772559.267492:0:5855:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796630400 00000100:00100000:0.0:1790772559.267603:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:0.0:1790772559.267617:0:5855:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+6:2353:x1877760796630400:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:0.0:1790772559.267674:0:5855:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1589 00000020:00010000:0.0:1790772559.267685:0:5855:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9328bf5f4800: total 0 00000100:00080000:0.0:1790772559.267692:0:5855:0:(import.c:65:import_set_state_nolock()) ffff9328bf5f6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772559.267732:0:5855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1790772559.268630:0:5855:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4553db9-253c-4dc5-b7ca-58baa04a749a+5:2353:x1877760796630400:12345-192.168.201.34@tcp:39:umount.0 Request processed in 1011us (1799us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1790772559.268641:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00000020:00010000:3.0:1790772559.268992:0:5844:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9328bf5f4800: total 0 00010000:00010000:3.0:1790772559.268999:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772559.269067:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9328bf5f4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790772559.269113:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328829d4f00) 00010000:00010000:3.0:1790772559.269118:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772559.269129:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be24a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50bf8 expref: 4 pid: 8380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772559.269162:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9328bf5f4800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790772559.269174:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772559.269176:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772559.269178:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772559.269694:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772559.318830:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772559.319055:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796630656 00000100:00100000:1.0:1790772559.319069:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796630656 00000100:00100000:1.0:1790772559.319143:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 306 00000100:00100000:1.0:1790772559.319155:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+7:2353:x1877760796630656:12345-192.168.201.34@tcp:251:umount.0 00000020:00000080:1.0:1790772559.319238:0:5850:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be147f 00000020:00010000:1.0:1790772559.319248:0:5850:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93288f27c000: total 0 00000100:00080000:1.0:1790772559.319253:0:5850:0:(import.c:65:import_set_state_nolock()) ffff93288f278800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790772559.319372:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932883158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd+3:2353:x1877760796630656:12345-192.168.201.34@tcp:251:umount.0 Request processed in 218us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.319382:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 306 00000020:00010000:3.0:1790772559.319686:0:8521:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93288f27c000: total 0 00010000:00010000:3.0:1790772559.319745:0:8521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93288f27c000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790772559.319790:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4da000/0xd3c7635991be1535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50791 expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772559.319819:0:8521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93288f27c000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1790772559.319831:0:8521:0:(genops.c:885:class_export_put()) final put ffff93288f27c000/2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd 00010000:00010000:3.0:1790772559.319852:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772559.319855:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772559.319857:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790772559.320618:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f27c000/2c93b5b6-52d7-4ab1-9f05-27cdc8e013fd for MGS 00000020:00000080:1.0:1790772559.320673:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f278800 for MGS 00000100:00100000:1.0:1790772559.565397:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813388032:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.565498:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.565578:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790772559.565585:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b933f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813387648:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.565618:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.565644:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813388160:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.565672:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.565716:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813387776:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.565742:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.565775:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813388288:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.565804:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.565824:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772559.565830:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0c0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813387904:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.565854:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772559.565919:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388032 00000100:00100000:1.0:1790772559.565929:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388032 00000100:00100000:1.0:1790772559.565985:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388288 00000100:00100000:1.0:1790772559.565988:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388288 00000100:00100000:1.0:1790772559.566036:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790772559.566046:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813388032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566111:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813388032:12345-0@lo:400:kworker.0 Request processed in 66us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.566119:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790772559.566139:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790772559.566144:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813388288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566175:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813388288:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.566181:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790772559.566199:0:5848:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387648 00000100:00100000:1.0:1790772559.566203:0:5848:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387648 00000100:00100000:1.0:1790772559.566240:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790772559.566247:0:5848:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813387648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566278:0:5848:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3315:x1877760813387648:12345-0@lo:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.566285:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790772559.566312:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388160 00000100:00100000:1.0:1790772559.566322:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388160 00000100:00100000:1.0:1790772559.566348:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387776 00000100:00100000:1.0:1790772559.566350:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387776 00000100:00100000:1.0:1790772559.566360:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813387904 00000100:00100000:1.0:1790772559.566362:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813387904 00000100:00100000:1.0:1790772559.566375:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790772559.566381:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813388160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566413:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813388160:12345-0@lo:400:kworker.0 Request processed in 32us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.566420:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790772559.566431:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790772559.566437:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813387776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566465:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813387776:12345-0@lo:400:kworker.0 Request processed in 29us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.566471:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790772559.566481:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790772559.566487:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813387904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566513:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813387904:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772559.566519:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1790772559.566553:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772559.566558:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772559.566606:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813387904:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566620:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813387776:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566630:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813388288:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566662:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b933f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813387648:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566682:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813388160:0@lo:400:kworker.0 00000100:00100000:1.0:1790772559.566693:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813388032:0@lo:400:kworker.0 00010000:00010000:0.0:1790772559.628163:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772560.075253:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813388416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772560.075341:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772560.075476:0:6707:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388416 00000100:00100000:2.0:1790772560.075488:0:6707:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388416 00000100:00100000:2.0:1790772560.075561:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790772560.075573:0:6707:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813388416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772560.075624:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772560.077168:0:6707:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813388416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1587us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772560.077184:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790772560.083691:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813388416:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1790772560.099434:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:2.0:1790772560.099448:0:6730:0:(genops.c:885:class_export_put()) final put ffff9328bf6ca800/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 00000020:00000080:0.0:1790772560.099528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf6ca800/0b5c3fb5-9865-4bac-a94a-29cd3a5b6677 for lustre-OST0000 00000020:00000080:0.0:1790772560.099582:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bf6ce000 for lustre-OST0000 00010000:00010000:3.0:1790772560.657547:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790772561.330952:0:12927:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790772561.354131:0:12927:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790772561.354373:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.354414:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.354423:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.354431:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.354465:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790772561.354471:0:12927:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790772561.354503:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772561.354509:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790772561.354516:0:12927:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790772561.354549:0:12927:0:(import.c:65:import_set_state_nolock()) ffff932894ae3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790772561.354750:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772561.354760:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.354769:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db400 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772561.354785:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.354796:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772561.354803:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772561.354809:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772561.354812:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790772561.354814:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790772561.354849:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.354856:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772561.354918:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.354926:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328ba4db400/0xd3c7635991be1504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be150b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.354941:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772561.354943:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772561.354945:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772561.354957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772561.354995:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813388672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772561.355096:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772561.355234:0:8465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388672 00000100:00100000:0.0:1790772561.355244:0:8465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388672 00000100:00100000:0.0:1790772561.355321:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772561.355343:0:8465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3316:x1877760813388672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772561.355372:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772561.355394:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be150b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be1504 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.355696:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772561.355746:0:8465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3316:x1877760813388672:12345-0@lo:103:ldlm_bl.0 Request processed in 405us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772561.355756:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772561.355807:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813388672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772561.357155:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813388544:0@lo:39:umount.0 00000100:00100000:1.0:1790772561.357263:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772561.358048:0:8380:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388544 00000100:00100000:2.0:1790772561.358066:0:8380:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388544 00000100:00100000:2.0:1790772561.358141:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790772561.358154:0:8380:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877760813388544:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790772561.358206:0:8380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be128e 00000100:00080000:2.0:1790772561.358219:0:8380:0:(import.c:65:import_set_state_nolock()) ffff9328b8d59800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790772561.358473:0:8380:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3314:x1877760813388544:12345-0@lo:39:umount.0 Request processed in 322us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772561.358482:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:2.0:1790772561.358497:0:8380:0:(genops.c:885:class_export_put()) final put ffff9328b8d5c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790772561.359043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b8d5c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790772561.359146:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328b8d59800 for lustre-MDT0000 00010000:00010000:0.0:1790772561.359260:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790772561.359917:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932894ae3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790772561.359941:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813388544:0@lo:39:umount.0 00000100:00080000:2.0:1790772561.359955:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772561.359972:0:12927:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf51f480 x1877760813388544/t0(0) o39->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772571 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772561.359996:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790772561.360003:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790772561.362326:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362350:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362431:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362440:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362475:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772561.362483:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362490:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362497:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362503:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362535:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772561.362588:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772561.362613:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362625:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bea00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:3.0:1790772561.362629:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362640:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772561.362647:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772561.362653:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790772561.362656:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1790772561.362696:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362703:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772561.362715:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362727:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362735:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362740:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362742:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362781:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bea00/0xd3c7635991be1512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362787:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790772561.362797:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362804:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772561.362804:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362815:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.362818:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362844:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030600 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:3.0:1790772561.362849:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362865:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772561.362872:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772561.362902:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790772561.362904:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790772561.362906:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790772561.362923:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362929:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772561.362959:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362966:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932880030600/0xd3c7635991be1439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362981:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772561.362985:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362990:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9e00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:3.0:1790772561.362993:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.362999:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772561.363015:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772561.363021:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790772561.363023:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790772561.363024:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790772561.363039:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.363045:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772561.363053:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.363059:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9e00/0xd3c7635991be173b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be1742 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.363068:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772561.363070:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772561.363072:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772561.363091:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813388928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772561.363163:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772561.363227:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772561.363233:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813389056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772561.363258:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772561.363293:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388928 00000100:00100000:3.0:1790772561.363302:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388928 00010000:00010000:2.0:1790772561.363325:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772561.363355:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790772561.363359:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813389056 00000100:00100000:3.0:1790772561.363364:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813389056 10000000:01000000:2.0:1790772561.363428:0:12927:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1790772561.363442:0:12927:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1790772561.363479:0:12927:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790772561.363485:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790772561.363492:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772561.363500:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1790772561.363508:0:12927:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93288830a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1790772561.363511:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1790772561.363522:0:12927:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9328bf9bf800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1790772561.363524:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790772561.363538:0:12927:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9328bf5f4800 a4553db9-253c-4dc5-b7ca-58baa04a749a 192.168.201.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1790772561.363540:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328813fc600 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772561.363545:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.363558:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772561.363564:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772561.363570:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772561.363572:0:5843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790772561.363574:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790772561.363593:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.363607:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772561.363616:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.363621:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fc600/0xd3c7635991be11ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be11f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772561.363635:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772561.363637:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772561.363638:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772561.363646:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790772561.363936:0:12927:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9328833f4d40) has exports, disconnecting them 00000020:00080000:2.0:1790772561.363942:0:12927:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93288830a800), last request at 1790772559 00000020:00000080:2.0:1790772561.363952:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1401 00000100:00080000:2.0:1790772561.363976:0:12927:0:(import.c:65:import_set_state_nolock()) ffff93288830d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790772561.364112:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790772561.364134:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+19:3317:x1877760813388928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772561.364150:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772561.364164:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030000/0xd3c7635991be1440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be1439 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790772561.364171:0:12927:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93288830a800): rc 0 00000020:00000080:2.0:1790772561.364188:0:12927:0:(genops.c:885:class_export_put()) final put ffff93288830a800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1790772561.364198:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1790772561.364206:0:12927:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9328bf9bf800), last request at 1790772559 00000020:00000080:2.0:1790772561.364213:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1336 00000100:00100000:3.0:1790772561.364253:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+18:3317:x1877760813388928:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.364261:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790772561.364280:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790772561.364285:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3317:x1877760813389056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772561.364292:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772561.364301:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be1742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be173b expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.364310:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772561.364330:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3317:x1877760813389056:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.364336:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:3.0:1790772561.364362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288830a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790772561.364427:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288830d000 for lustre-MDT0000 00000100:00100000:3.0:1790772561.364461:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813389056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772561.364470:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12e36d38-efd9-4a85-b7c8-c9520302915a:3317:1877760813388928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772561.364636:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772561.364648:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813388800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772561.364680:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772561.364680:0:12927:0:(import.c:65:import_set_state_nolock()) ffff9328bf9b9800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790772561.364706:0:12927:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9328bf9bf800): rc 0 00000020:00000080:2.0:1790772561.364709:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328bf9bf800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1790772561.364733:0:12927:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7e0c1a57ae0 00000100:00100000:3.0:1790772561.364734:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772561.364750:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813389184:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790772561.364762:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790772561.364767:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:3.0:1790772561.364778:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790772561.364795:0:12927:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1790772561.364810:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf9bf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790772561.364853:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bf9b9800 for lustre-MDT0000 00000100:00100000:3.0:1790772561.364866:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813388800 00000100:00100000:3.0:1790772561.364871:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813388800 00000100:00100000:3.0:1790772561.364916:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813389184 00000100:00100000:3.0:1790772561.364919:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813389184 00000100:00100000:3.0:1790772561.364933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772561.364939:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+17:3316:x1877760813388800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772561.364958:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772561.364969:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4da400/0xd3c7635991be1519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be1512 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.364978:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772561.365007:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+16:3316:x1877760813388800:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.365013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772561.365028:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772561.365034:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+15:3316:x1877760813389184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772561.365041:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772561.365049:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932881681800/0xd3c7635991be11f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be11ed expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772561.365062:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772561.365091:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e36d38-efd9-4a85-b7c8-c9520302915a+14:3316:x1877760813389184:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772561.365109:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1790772561.365141:0:12927:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1790772561.365160:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813389184:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790772561.365171:0:12927:0:(import.c:65:import_set_state_nolock()) ffff932783098800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790772561.365195:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813388800:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790772561.365206:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790772561.365210:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1790772561.365232:0:12927:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790772561.365310:0:12927:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790772561.365320:0:12927:0:(import.c:65:import_set_state_nolock()) ffff932883150000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790772561.365355:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9328833f4d40) has no exports 00000100:00100000:1.0:1790772561.366125:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813389312:0@lo:9:umount.0 00000100:00100000:1.0:1790772561.366171:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.366213:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813389440:0@lo:9:umount.0 00000100:00100000:1.0:1790772561.366233:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772561.366264:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813389312 00000100:00100000:1.0:1790772561.366269:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813389312 00000100:00100000:1.0:1790772561.366302:0:12032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813389440 00000100:00100000:1.0:1790772561.366305:0:12032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813389440 00000100:00100000:1.0:1790772561.366325:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772561.366332:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b933f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877760813389312:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790772561.366359:0:12032:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1383 00000100:00080000:1.0:1790772561.366368:0:12032:0:(import.c:65:import_set_state_nolock()) ffff9328bf6cc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772561.366659:0:12032:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1790772561.367087:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b933f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3314:x1877760813389312:12345-0@lo:9:umount.0 Request processed in 754us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772561.367099:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772561.367124:0:12032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772561.367185:0:12032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1877760813389440:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790772561.367324:0:12032:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be146a 00000100:00080000:1.0:1790772561.367333:0:12032:0:(import.c:65:import_set_state_nolock()) ffff93288f0a3800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790772561.368839:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1790772561.369080:0:12032:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790772561.369626:0:12032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3314:x1877760813389440:12345-0@lo:9:umount.0 Request processed in 2453us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772561.369639:0:12032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1790772561.369678:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772561.369683:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772561.369726:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932783098800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790772561.369748:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790772561.369750:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772561.369753:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813389312:0@lo:9:umount.0 00000100:00080000:1.0:1790772561.369766:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932883150000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790772561.369777:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790772561.369779:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772561.369781:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813389440:0@lo:9:umount.0 00010000:00010000:0.0:1790772561.370205:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772561.370216:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772561.370271:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790772561.375115:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9328833f4d40) has no exports 00000020:00000080:3.0:1790772561.447306:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1248 00000020:00000080:3.0:1790772561.447324:0:12927:0:(genops.c:885:class_export_put()) final put ffff932883151800/lustre-QMT0000_UUID 00000020:01000000:3.0:1790772561.447350:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790772561.447436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff932883151800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790772561.447447:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772561.447467:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790772561.447473:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9328ba5f19c0) has no exports 00000020:00000080:2.0:1790772561.447740:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1241 00000020:00000080:2.0:1790772561.447752:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328ba60f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790772561.447852:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772561.447861:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790772561.447864:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328ba5ec800/lustre-QMT0000_UUID 00000020:00000080:2.0:1790772561.447867:0:12927:0:(genops.c:844:class_export_destroy()) destroying export ffff9328ba5ec800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790772561.447900:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1790772561.454124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328ba60f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1790772561.676066:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790772562.678126:0:5878:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a4553db9-253c-4dc5-b7ca-58baa04a749a 00000001:00080000:2.0:1790772562.678142:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1790772562.678147:0:5878:0:(genops.c:885:class_export_put()) final put ffff9328bf5f4800/a4553db9-253c-4dc5-b7ca-58baa04a749a 00000020:00000080:1.0:1790772562.678399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf5f4800/a4553db9-253c-4dc5-b7ca-58baa04a749a for lustre-MDT0000 00000020:00000080:1.0:1790772562.678463:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bf5f6000 for lustre-MDT0000 00010000:00010000:0.0:1790772562.699216:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772563.209741:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772563.209753:0:7658:0:(genops.c:885:class_export_put()) final put ffff93288f0a1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772563.209955:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f0a1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790772563.211998:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f0a3800 for lustre-OST0001 00000020:01000000:2.0:1790772563.467024:0:12927:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9328b2113d80 - data ffff9328b1fbcbd0/ffff9328b9881800 00000020:01000000:2.0:1790772563.467213:0:12927:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff932898845720 - data ffff9328b1e7f948/ffff9328b8d9d000 00000001:00000004:2.0:1790772563.474468:0:12927:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1790772563.573732:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790772563.573742:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790772563.573773:0:12927:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790772563.573776:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790772563.574357:0:6988:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790772563.574363:0:6988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1790772563.574373:0:6988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790772563.576600:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790772563.576609:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1790772563.576623:0:12927:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790772563.576625:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790772563.578088:0:8022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790772563.578095:0:8022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1790772563.578107:0:8022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790772563.656606:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1210 00000020:00000080:0.0:1790772563.656620:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328b9be8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790772563.657333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b9be8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790772563.659340:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1225 00000020:00000080:0.0:1790772563.659353:0:12927:0:(genops.c:885:class_export_put()) final put ffff932883155800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790772563.659408:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790772563.659415:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772563.659423:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790772563.659427:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9328833f3380) has no exports 00000004:01000000:0.0:1790772563.659603:0:12927:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790772563.659612:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1463 00000020:00000080:0.0:1790772563.659616:0:12927:0:(genops.c:885:class_export_put()) final put ffff93288f27a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790772563.660967:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790772563.660978:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772563.661000:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790772563.661004:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9328b9bf4d40) has no exports 00000020:00000080:0.0:1790772563.661013:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be145c 00000020:00000080:0.0:1790772563.661019:0:12927:0:(genops.c:885:class_export_put()) final put ffff932883152000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790772563.661605:0:12927:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790772563.661610:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790772563.661614:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1790772563.661620:0:12927:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790772563.661622:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790772563.661665:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772563.661673:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772563.661678:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be137c 00000020:00000080:0.0:1790772563.661682:0:12927:0:(genops.c:885:class_export_put()) final put ffff93278309f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790772563.661686:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790772563.661690:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772563.661693:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790772563.661696:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9328b9bf19c0) has no exports 00000020:00000080:0.0:1790772563.661700:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1375 00000020:00000080:0.0:1790772563.661703:0:12927:0:(genops.c:885:class_export_put()) final put ffff93278309c000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790772563.662737:0:12927:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790772563.662743:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790772563.662746:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1790772563.662751:0:12927:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790772563.662753:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790772563.662831:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772563.662839:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772563.662870:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772563.662902:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772563.662940:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be122c 00000020:00000080:0.0:1790772563.662947:0:12927:0:(genops.c:885:class_export_put()) final put ffff932883152800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790772563.663124:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff932883155800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1790772563.663131:0:37:0:(genops.c:885:class_export_put()) final put ffff9328b9bea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772563.663133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b9bea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790772563.663149:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790772563.664923:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790772563.664935:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772563.664943:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790772563.664948:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9328b9bf0000) has no exports 00000020:00000080:0.0:1790772563.664983:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772563.664999:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790772563.665006:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1233 00000020:00000080:0.0:1790772563.665014:0:12927:0:(genops.c:885:class_export_put()) final put ffff932883153000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790772563.665025:0:12927:0:(tgt_mount.c:187:server_put_mount()) put mount ffff932891b62000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790772563.665029:0:12927:0:(obd_mount.c:710:lustre_put_lsi()) put ffff932891b62000 3 00000020:01000004:0.0:1790772563.665032:0:12927:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff932891b62000 from lustre-MDT0000 00000020:00000080:0.0:1790772563.665052:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772563.665056:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790772563.665058:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328b9bec000/lustre-MDT0000_UUID 00000020:00000080:0.0:1790772563.665061:0:12927:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b9bec000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790772563.665072:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790772563.665153:0:12927:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1790772563.665157:0:12927:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790772563.665160:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790772563.665163:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772563.665166:0:12927:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790772563.665172:0:12927:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff932894bb6000 12e36d38-efd9-4a85-b7c8-c9520302915a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772563.665188:0:12927:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9328882f19c0) has exports, disconnecting them 00000020:00080000:0.0:1790772563.665192:0:12927:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff932894bb6000), last request at 1790772327 00000020:00000080:0.0:1790772563.665208:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be11d1 00000020:00010000:0.0:1790772563.665212:0:12927:0:(genops.c:1920:obd_stale_export_put()) Put export ffff932894bb6000: total 6 00000100:00080000:0.0:1790772563.665217:0:12927:0:(import.c:65:import_set_state_nolock()) ffff932894bb4800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790772563.665233:0:12927:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff932894bb6000): rc 0 00000020:00080000:0.0:1790772563.665237:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9328882f19c0) has no exports 00000100:00100000:0.0:1790772563.665309:0:5849:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9328b1798200:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1790772563.665396:0:5848:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9328b1798000:5848] 0 exiting: rc = 1 00000020:00000080:1.0:1790772563.665738:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f27a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790772563.665748:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff932883152000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772563.665761:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff932883150000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790772563.665766:0:37:0:(genops.c:885:class_export_put()) final put ffff93288f008800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772563.665768:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f008800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790772563.665771:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772563.665815:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93278309f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790772563.665823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93278309c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772563.665831:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff932783098800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790772563.665835:0:37:0:(genops.c:885:class_export_put()) final put ffff93278309a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772563.665838:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93278309a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790772563.665841:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772563.665953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff932883152800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790772563.665957:0:37:0:(genops.c:885:class_export_put()) final put ffff9328b9be9800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790772563.665958:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b9be9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790772563.665962:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790772563.666120:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff932883153000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1790772563.666155:0:5850:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9328b1528400:5850] 2 exiting: rc = 0 00000020:00010000:2.0:1790772563.666277:0:5844:0:(genops.c:1906:obd_stale_export_get()) Get export ffff932894bb6000: total 0 00010000:00010000:2.0:1790772563.666312:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff932894bb6000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1790772563.666340:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030400/0xd3c7635991be12e9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be12e2 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666360:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328c12bf800/0xd3c7635991be1527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be1520 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666372:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4daa00/0xd3c7635991be1726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be171f expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666381:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be1734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be172d expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4dbc00/0xd3c7635991be14d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be14cc expref: 5 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666405:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be14ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be14e8 expref: 4 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666414:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4dbe00/0xd3c7635991be14e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be14da expref: 3 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666425:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328ba4da600/0xd3c7635991be14fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd3c7635991be14f6 expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772563.666435:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff932894bb6000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1790772563.666446:0:5844:0:(genops.c:885:class_export_put()) final put ffff932894bb6000/12e36d38-efd9-4a85-b7c8-c9520302915a 00010000:00010000:2.0:1790772563.666460:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772563.666462:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772563.666464:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790772563.666522:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff932894bb6000/12e36d38-efd9-4a85-b7c8-c9520302915a for MGS 00000020:00000080:1.0:1790772563.666550:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff932894bb4800 for MGS 00000100:00100000:0.0:1790772563.666698:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666706:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666712:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666720:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666726:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666733:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666739:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666746:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666752:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666757:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666762:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666767:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666772:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666777:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666783:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666788:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666793:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666799:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666804:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666809:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666814:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666818:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666824:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666830:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666836:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666840:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666845:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666850:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666854:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666860:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666864:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666870:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666901:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666915:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666920:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666925:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666930:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666936:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666941:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666947:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666953:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666959:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666965:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666971:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666977:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.666981:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667031:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667038:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667043:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667048:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667053:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667057:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667062:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667067:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667072:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667077:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667082:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667087:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667093:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667099:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667105:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667110:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667115:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.667121:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790772563.667571:0:12927:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790772563.667574:0:12927:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1790772563.668834:0:12927:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9328bf556960 - data ffff932898f45438/ffff9328bfc09000 00000020:01000000:0.0:1790772563.668983:0:12927:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93289c7095a0 - data ffff9328b1c2d000/ffff9328831fa000 00000020:00000080:0.0:1790772563.669501:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be11b5 00000020:00000080:0.0:1790772563.669509:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328a0235800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790772563.669525:0:12927:0:(tgt_mount.c:187:server_put_mount()) put mount ffff932891b62000 from MGS, refs=2 00000020:01000004:0.0:1790772563.669529:0:12927:0:(obd_mount.c:710:lustre_put_lsi()) put ffff932891b62000 2 00000020:01000004:0.0:1790772563.669532:0:12927:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff932891b62000 from MGS 00000020:00000080:0.0:1790772563.669560:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772563.669566:0:12927:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790772563.669569:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328a0230000/MGS 00000020:00000080:0.0:1790772563.669571:0:12927:0:(genops.c:844:class_export_destroy()) destroying export ffff9328a0230000/MGS for MGS 00000020:01000000:0.0:1790772563.669577:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790772563.669636:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790772563.669640:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772563.669645:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790772563.669652:0:12927:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff932894ae5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772563.669658:0:12927:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9328ba5f3380) has exports, disconnecting them 00000020:00080000:0.0:1790772563.669662:0:12927:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff932894ae5800), last request at 1790772328 00000020:00000080:0.0:1790772563.669666:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1280 00000020:00080000:0.0:1790772563.669677:0:12927:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff932894ae5800): rc 0 00000020:00000080:0.0:1790772563.669682:0:12927:0:(genops.c:885:class_export_put()) final put ffff932894ae5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790772563.670470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328a0235800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790772563.670494:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff932894ae5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790772563.670927:0:12927:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790772563.670932:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772563.670935:0:12927:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790772563.670941:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772563.671103:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772563.671110:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790772563.671115:0:12927:0:(obd_mount.c:710:lustre_put_lsi()) put ffff932891b62000 1 00000020:00000080:1.0:1790772563.671119:0:12927:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be11a7 00000020:00000080:1.0:1790772563.671126:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328a0234000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790772563.671130:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790772563.671152:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772563.671155:0:12927:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790772563.671158:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9328833f0000) has no exports 00000020:00000080:2.0:1790772563.671717:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff932894ae3800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790772563.671726:0:36:0:(genops.c:885:class_export_put()) final put ffff9328ba60f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790772563.671728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328ba60f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1790772563.671733:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1790772563.671786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328a0234000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772563.702433:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772563.702449:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790772563.702454:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328a165d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790772563.702459:0:12927:0:(genops.c:844:class_export_destroy()) destroying export ffff9328a165d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790772563.702466:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790772563.702606:0:12927:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff932891b60800 00000020:01000000:1.0:1790772563.702628:0:12927:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790772563.702632:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772563.702637:0:12927:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790772563.702642:0:12927:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9328833f19c0) has no exports 00000100:00100000:1.0:1790772563.702711:0:5855:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff932883049e00:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1790772563.702810:0:5857:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff932883048c00:5857] 2 exiting: rc = 0 00000100:00100000:1.0:1790772563.702867:0:5856:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff932883048e00:5856] 1 exiting: rc = 0 00000100:00100000:2.0:1790772563.705936:0:8380:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9328bf4b9400:8380] 3 exiting: rc = 0 00000100:00100000:1.0:1790772563.706175:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706194:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706201:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706206:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706212:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706217:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706223:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706228:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706243:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706252:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706257:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706263:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706268:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706274:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706280:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706286:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706291:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706310:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706317:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706323:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706328:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706333:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706338:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706343:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706349:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706363:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706369:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706374:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706380:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706385:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706389:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706395:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706400:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706404:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706409:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706413:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706418:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706423:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706428:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706433:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706438:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706443:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706448:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706455:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706462:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706469:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706475:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706480:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706486:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706491:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706498:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706505:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706519:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706525:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706531:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706537:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706542:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706548:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706554:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706559:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706564:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706568:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706574:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.706579:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.711080:0:5858:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff932883048000:5858] 0 exiting: rc = 1 00000100:00100000:2.0:1790772563.711219:0:5859:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff932883048200:5859] 1 exiting: rc = 0 00000100:00100000:1.0:1790772563.711513:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711521:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711528:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711534:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711539:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711544:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711550:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711556:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711562:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711566:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711572:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711578:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711584:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711589:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711595:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711600:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711605:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711610:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711616:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711621:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711626:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711631:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711636:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711656:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711660:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711666:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711671:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711676:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711682:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711687:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711692:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711697:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711703:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711708:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711714:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711720:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711725:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711730:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711736:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711741:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711745:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711750:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711756:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711761:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711766:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711771:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711776:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711781:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711786:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711792:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711797:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711802:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711807:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711813:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711819:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711825:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711832:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711837:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711850:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711856:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711861:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711866:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711871:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.711904:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.712465:0:5860:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff932888240000:5860] 0 exiting: rc = 1 00000100:00100000:3.0:1790772563.712817:0:5861:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff932888240200:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1790772563.713042:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713052:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713060:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713077:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713085:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713092:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713097:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713103:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713109:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713116:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713122:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713127:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713133:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713151:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713156:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713177:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713467:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713475:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713482:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713488:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713494:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713500:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713506:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713511:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713517:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713522:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713528:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713550:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713557:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713574:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713580:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713598:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713604:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713610:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713617:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713622:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713628:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713634:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713640:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713665:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713673:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713679:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713685:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713692:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713697:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713703:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713709:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713716:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713723:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713729:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713735:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713756:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713763:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713770:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713776:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713782:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713789:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713796:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713803:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713809:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713815:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713822:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713829:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.713835:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.723350:0:5862:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff932888241400:5862] 0 exiting: rc = 1 00000100:00100000:0.0:1790772563.723784:0:5863:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff932888240600:5863] 1 exiting: rc = 0 00000100:00100000:1.0:1790772563.724029:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724036:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724041:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724046:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724051:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724056:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724061:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724066:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724071:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724076:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724083:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724089:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724094:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724099:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724105:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724110:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724116:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724121:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724128:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724145:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724151:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724156:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724162:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724167:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724171:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724176:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724252:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724257:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724262:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724267:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724271:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724277:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724281:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724286:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724304:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724310:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724315:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724321:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724326:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724331:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724337:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724342:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724347:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724353:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724358:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724362:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724367:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724371:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724376:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724381:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724387:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724391:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724395:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724400:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724405:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724409:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724414:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724419:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724425:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724430:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724434:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724439:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724444:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.724449:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725038:0:5864:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff932888240400:5864] 0 exiting: rc = 1 00000100:00100000:3.0:1790772563.725360:0:5865:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff932888241a00:5865] 1 exiting: rc = 0 00000100:00100000:1.0:1790772563.725653:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725660:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725665:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725670:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725683:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725687:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725692:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725698:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725702:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725708:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725713:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725718:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725723:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725728:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725733:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725738:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725743:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725748:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725754:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725759:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725764:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725769:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725774:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725779:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725784:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725789:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725794:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725799:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725804:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725809:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725814:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725819:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725824:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725829:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725834:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725839:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725843:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725849:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725854:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725867:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725872:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725895:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725901:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725906:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725911:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725916:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725921:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725926:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725931:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725936:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725941:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725945:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725950:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725955:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725960:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725965:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725970:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725975:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725980:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725985:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725989:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725994:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.725999:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.726005:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772563.726377:0:5867:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff932888241c00:5867] 1 exiting: rc = 0 00010000:00010000:1.0:1790772563.727018:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772563.727165:0:5866:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff932888241800:5866] 0 exiting: rc = 1 00000100:00100000:2.0:1790772563.727472:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727479:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727485:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727490:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727494:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727500:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727505:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727510:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727515:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727520:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727527:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727533:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727539:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727545:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727550:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727555:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727561:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727566:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727572:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727577:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727713:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727722:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727735:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727740:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727745:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727750:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727755:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727760:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727765:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727770:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727775:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727780:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727784:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727789:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727794:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727799:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727803:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727808:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727813:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727818:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727822:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727827:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727832:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727837:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727842:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727847:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727852:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727858:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727863:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727868:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727939:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727945:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727951:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727956:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727961:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727966:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727971:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727982:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727987:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727992:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.727997:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.728002:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.728006:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.728012:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772563.732925:0:5869:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff932888240e00:5869] 1 exiting: rc = 0 00000100:00100000:1.0:1790772563.735068:0:5868:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff932888241e00:5868] 0 exiting: rc = 1 00000100:00100000:1.0:1790772563.735317:0:5870:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9328b8d61c00:5870] 2 exiting: rc = 0 00000100:00100000:2.0:1790772563.735445:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735453:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735460:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735466:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735474:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735480:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735486:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735492:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735498:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735503:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735524:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735531:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735536:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735541:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735546:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735551:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735556:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735562:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735568:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735575:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735580:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735601:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735607:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735612:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735617:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735624:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735630:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735635:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735655:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735661:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735668:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735674:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735680:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735686:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735708:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735716:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735721:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735727:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735732:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735736:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735741:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735746:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735751:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735757:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735762:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735768:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735774:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735780:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735785:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735790:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735795:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735800:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735806:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735811:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735818:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735825:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735830:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735834:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735840:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735845:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735851:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735856:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735861:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772563.735900:0:12927:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790772563.741108:0:12927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772563.741122:0:12927:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790772563.741128:0:12927:0:(genops.c:885:class_export_put()) final put ffff9328a1644000/MDS_uuid 00000020:00000080:2.0:1790772563.741145:0:12927:0:(genops.c:844:class_export_destroy()) destroying export ffff9328a1644000/MDS_uuid for MDS 00000020:01000000:2.0:1790772563.741156:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790772563.741360:0:12927:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1790772564.684087:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813389696:0@lo:400:kworker.0 00000400:00000100:1.0:1790772564.684156:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813389696 offset 0 length 224: 4 00000100:00100000:1.0:1790772564.684218:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772564.684224:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813389824:0@lo:400:kworker.0 00000400:00000100:1.0:1790772564.684259:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813389824 offset 0 length 224: 4 00000100:00100000:3.0:1790772564.684417:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813389568:0@lo:400:kworker.0 00000400:00000100:3.0:1790772564.684443:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760813389568 offset 0 length 224: 4 00010000:00010000:0.0:1790772564.750921:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790772565.229250:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772565.229258:0:6730:0:(genops.c:885:class_export_put()) final put ffff9328bf6ce800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790772565.229338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf6ce800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790772565.229635:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bf6cc800 for lustre-OST0000 00010000:00010000:2.0:1790772565.771960:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772566.797162:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790772567.283502:0:13080:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790772567.304295:0:13080:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790772567.304347:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.304361:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.304369:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.304377:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772567.304397:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790772567.304402:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790772567.304421:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772567.304432:0:13080:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf62b480 x1877760813389696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790772567.304545:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772567.304552:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.304560:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf200 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772567.304563:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.304586:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772567.304593:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772567.304598:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772567.304601:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790772567.304603:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790772567.304641:0:8521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.304648:0:8521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772567.304674:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.304681:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bf200/0xd3c7635991be14e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd3c7635991be14ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772567.304692:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.304694:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772567.304696:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772567.306237:0:13080:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790772567.306252:0:13080:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790772567.306280:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9328bf9bc800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790772567.306401:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1877760813390080:0@lo:39:umount.0 00000400:00000100:0.0:1790772567.306458:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813390080 offset 0 length 224: 4 00000100:00100000:1.0:1790772567.306645:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813389952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772567.306690:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772567.307052:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813389952 00000100:00100000:2.0:1790772567.307060:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813389952 00000100:00100000:2.0:1790772567.307115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790772567.307123:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3315:x1877760813389952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790772567.307130:0:5842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772567 with bad export cookie 15260275098716606929 00000100:00100000:3.0:1790772567.308733:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813389696:0@lo:400:kworker.0 00000100:00100000:2.0:1790772567.318862:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3315:x1877760813389952:12345-0@lo:103:ldlm_bl.0 Request processed in 11729us (12163us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790772567.318901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1790772567.318913:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790772567.318928:0:3315:0:(import.c:65:import_set_state_nolock()) ffff932888221000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790772567.318933:0:3315:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1790772567.333944:0:3315:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.134@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790772567.333950:0:3315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790772567.333960:0:3315:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf62a300 x1877760813389568/t0(0) o400->MGC192.168.201.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790772580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772567.333990:0:3315:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93288f0ced80 x1877760813389952/t0(0) o103->MGC192.168.201.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772583 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790772567.333999:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790772567.334002:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790772567.334003:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790772567.334007:0:3315:0:(import.c:65:import_set_state_nolock()) ffff932888221000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772567.334013:0:3315:0:(import.c:545:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1790772567.334030:0:3315:0:(import.c:666:import_select_connection()) MGC192.168.201.134@tcp: import ffff932888221000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772567.334066:0:3315:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf628380 x1877760813390208/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772567.334120:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12e36d38-efd9-4a85-b7c8-c9520302915a:3315:1877760813389952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772567.334365:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12e36d38-efd9-4a85-b7c8-c9520302915a:3314:1877760813390208:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1790772567.334416:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760813390208 offset 0 length 520: 4 00000100:00100000:3.0:1790772567.334799:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12e36d38-efd9-4a85-b7c8-c9520302915a:3316:1877760813389568:0@lo:400:kworker.0 00010000:00010000:2.0:1790772567.819059:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772568.846757:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790772569.803073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790772569.803084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790772569.803324:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813390336:0@lo:400:kworker.0 00000400:00000100:3.0:1790772569.803416:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813390336 offset 0 length 224: 4 00010000:00010000:0.0:1790772569.869444:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772570.893990:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772571.915177:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772572.811285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772572.811296:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790772572.811517:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772572.811540:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813390464:0@lo:400:kworker.0 00000400:00000100:1.0:1790772572.811596:0:3318:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813390464 offset 0 length 224: 4 00010000:00010000:0.0:1790772572.939285:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772573.967513:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772574.987357:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772576.011255:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772577.035296:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772577.483115:0:3314:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772567/real 1790772567] req@ffff9328bf628380 x1877760813390208/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790772577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772577.483168:0:3314:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9328bf628380 x1877760813390208/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790772577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772577.483183:0:3314:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772567/real 1790772567] req@ffff9328bf51ed80 x1877760813390080/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772577.483196:0:3314:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9328bf51ed80 x1877760813390080/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772577.483220:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932888221000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772577.483262:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790772577.483267:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12e36d38-efd9-4a85-b7c8-c9520302915a:3314:1877760813390208:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1790772577.483284:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9328bf9bc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790772577.483304:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1877760813390080:0@lo:39:umount.0 00000100:00080000:2.0:1790772577.483548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772577.483554:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790772577.483559:0:36:0:(import.c:65:import_set_state_nolock()) ffff932888221000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772577.483565:0:36:0:(import.c:545:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 388 00000100:00080000:2.0:1790772577.483572:0:36:0:(import.c:630:import_select_connection()) MGC192.168.201.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790772577.483588:0:36:0:(import.c:666:import_select_connection()) MGC192.168.201.134@tcp: import ffff932888221000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1790772577.483639:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf51f800 x1877760813390592/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772577.483727:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772577.483744:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813390720:0@lo:400:kworker.0 00000400:00000100:2.0:1790772577.483811:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813390720 offset 0 length 224: 4 00000100:00080000:3.0:1790772577.484204:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772577.484211:0:13080:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790772577.484218:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790772577.485259:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485304:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485312:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485320:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485356:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772577.485364:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485370:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485376:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485382:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772577.485395:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790772577.485399:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1790772577.485427:0:13080:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790772577.485433:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790772577.485440:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772577.485447:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772577.485452:0:13080:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff932894b73380) has no exports 00000020:00080000:3.0:1790772577.485489:0:13080:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff932894b73380) has no exports 00000020:01000000:3.0:1790772577.487463:0:13080:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9328b2113600 - data ffff93289cba7bd0/ffff9328b9881c00 00000020:01000000:3.0:1790772577.487733:0:13080:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9328919ecc00 - data ffff9328b1ebc1b0/ffff9328bf665c00 00010000:00010000:2.0:1790772577.491571:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772577.491621:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491639:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bee00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772577.491645:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491660:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772577.491669:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772577.491676:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772577.491680:0:5843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790772577.491684:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790772577.491716:0:5843:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:2.0:1790772577.491723:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491731:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bee00/0xd3c7635991be14f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be14fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491758:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772577.491764:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491770:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93000 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772577.491774:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491793:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772577.491799:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772577.491805:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790772577.491807:0:5843:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790772577.491809:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790772577.491816:0:5843:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:2.0:1790772577.491819:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491826:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93289ed93000/0xd3c7635991be172d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be1734 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772577.491835:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772577.491837:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772577.491842:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772577.493068:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772577.493101:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12e36d38-efd9-4a85-b7c8-c9520302915a:3314:1877760813390592:0@lo:250:kworker.0 00000400:00000100:0.0:1790772577.493207:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760813390592 offset 0 length 520: 4 00100000:10000000:3.0:1790772577.524045:0:13080:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790772577.610088:0:13080:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be1305 00000020:00000080:0.0:1790772577.610099:0:13080:0:(genops.c:885:class_export_put()) final put ffff9328bf6cc000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790772577.610118:0:13080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9328ba5e9800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790772577.610121:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328ba5e9800 2 00000020:01000004:0.0:1790772577.610125:0:13080:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9328ba5e9800 from lustre-OST0000 00000020:00000080:0.0:1790772577.610147:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772577.610157:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790772577.610159:0:13080:0:(genops.c:885:class_export_put()) final put ffff9328bf6cb000/lustre-OST0000_UUID 00000020:00000080:0.0:1790772577.610177:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf6cb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790772577.610184:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790772577.610229:0:13080:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790772577.610234:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790772577.610239:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772577.610244:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790772577.610251:0:13080:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9328bf9b8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772577.610256:0:13080:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9328882f4d40) has exports, disconnecting them 00000020:00080000:0.0:1790772577.610261:0:13080:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9328bf9b8800), last request at 1790772347 00000020:00000080:0.0:1790772577.610265:0:13080:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be132f 00000020:00080000:0.0:1790772577.610276:0:13080:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9328bf9b8800): rc 0 00000020:00000080:0.0:1790772577.610281:0:13080:0:(genops.c:885:class_export_put()) final put ffff9328bf9b8800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790772577.611201:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf6cc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790772577.611219:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf9b8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790772577.618520:0:13080:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790772577.618529:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772577.618534:0:13080:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790772577.618542:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772577.618578:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bf9bc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790772577.618752:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772577.618764:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790772577.618770:0:13080:0:(genops.c:885:class_export_put()) final put ffff9328bf461000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790772577.618774:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf461000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790772577.618788:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1790772577.618850:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328ba5e9800 1 00000020:00000080:1.0:1790772577.618857:0:13080:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be12bf 00000020:00000080:1.0:1790772577.618864:0:13080:0:(genops.c:885:class_export_put()) final put ffff9328b23b8800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1790772577.618908:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790772577.618917:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b23b8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790772577.618928:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772577.618933:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790772577.618945:0:13080:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9328882f3380) has no exports 00000020:00000080:3.0:1790772577.650364:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772577.650381:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790772577.650386:0:13080:0:(genops.c:885:class_export_put()) final put ffff9328ba721800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790772577.650391:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9328ba721800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790772577.650398:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790772577.650558:0:13080:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9328ba5e8800 00000020:02000400:3.0:1790772577.650614:0:13080:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790772578.059048:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772579.088212:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772580.113261:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1790772580.555060:0:3317:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772564/real 1790772564] req@ffff9328bf629180 x1877760813389824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.596480:0:3317:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9328bf629180 x1877760813389824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790772580 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772580.596497:0:3317:0:(import.c:65:import_set_state_nolock()) ffff93288f27a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790772580.596501:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790772580.613572:0:3317:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1790772580.615813:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813389824:0@lo:400:kworker.0 00000100:00080000:0.0:1790772580.617569:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790772580.617580:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772580.617583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790772580.617586:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790772580.617590:0:36:0:(import.c:65:import_set_state_nolock()) ffff93288f27a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772580.617598:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 187 00000100:00080000:0.0:1790772580.617615:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93288f27a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1790772580.617652:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93288f0cd880 x1877760813390848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772580.617763:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1877760813390848:0@lo:38:kworker.0 00000400:00000100:2.0:1790772580.617818:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760813390848 offset 0 length 520: 4 00000020:01000004:3.0:1790772580.797168:0:13232:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790772580.817050:0:13232:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790772580.817155:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.817171:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.817446:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.817453:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.817480:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790772580.817486:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790772580.817510:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772580.817521:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf628e00 x1877760813390336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772585 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817548:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf51ea00 x1877760813390464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817565:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf51d500 x1877760813390720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817580:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93288f0cd880 x1877760813390848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772590 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817591:0:13232:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790772580.817596:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790772580.817603:0:13232:0:(import.c:65:import_set_state_nolock()) ffff93288f27a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790772580.817608:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772580.817612:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf628e00 x1877760813390336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772585 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817619:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf51ea00 x1877760813390464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772588 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817626:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf51d500 x1877760813390720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772593 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817641:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93288f0cd880 x1877760813390848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772590 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772580.817646:0:13232:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790772580.817650:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1790772580.817836:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813390464:0@lo:400:kworker.0 00000100:00100000:0.0:1790772580.818044:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813390336:0@lo:400:kworker.0 00010000:00010000:2.0:1790772580.819062:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772580.819074:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772580.819105:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf600 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:2.0:1790772580.819109:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772580.819123:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772580.819131:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772580.819137:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772580.819141:0:5844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790772580.819144:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790772580.819160:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:2.0:1790772580.819164:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772580.819171:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328c12bf600/0xd3c7635991be14cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be14d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772580.819185:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772580.819188:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772580.819189:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772580.819218:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813390720:0@lo:400:kworker.0 00000100:00100000:2.0:1790772580.819267:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1877760813390848:0@lo:38:kworker.0 00010000:00010000:3.0:1790772580.821706:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821724:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821731:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821738:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821764:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772580.821771:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821777:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821782:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821788:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772580.821830:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790772580.821835:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790772580.821867:0:13232:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790772580.821871:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790772580.821903:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772580.821909:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772580.821914:0:13232:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff932894b74d40) has no exports 00000020:00080000:3.0:1790772580.821944:0:13232:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff932894b74d40) has no exports 00010000:00010000:0.0:1790772580.822521:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772580.822535:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822560:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932881518200 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772580.822563:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822572:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772580.822578:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772580.822584:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772580.822586:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790772580.822589:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1790772580.822604:0:8521:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:0.0:1790772580.822608:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822615:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881518200/0xd3c7635991be14da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be14e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822629:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772580.822631:0:8521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822636:0:8521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92800 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772580.822639:0:8521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822645:0:8521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772580.822657:0:8521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772580.822662:0:8521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790772580.822664:0:8521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790772580.822666:0:8521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790772580.822672:0:8521:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:0.0:1790772580.822675:0:8521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822681:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93289ed92800/0xd3c7635991be171f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be1726 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.822694:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772580.822696:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772580.822698:0:8521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772580.822772:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790772580.826699:0:13232:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9328c0c20de0 - data ffff9328bfff4288/ffff9328bf656800 00000020:01000000:3.0:1790772580.827057:0:13232:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9328b9b4ef00 - data ffff9328b1e40000/ffff9328bfdab800 00100000:10000000:3.0:1790772580.843110:0:13232:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790772580.892513:0:13232:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be13d0 00000020:00000080:0.0:1790772580.892524:0:13232:0:(genops.c:885:class_export_put()) final put ffff93288f27f000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790772580.892557:0:13232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9328bb7d8800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790772580.892561:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328bb7d8800 2 00000020:01000004:0.0:1790772580.892564:0:13232:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9328bb7d8800 from lustre-OST0001 00000020:00000080:0.0:1790772580.892589:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772580.892599:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790772580.892601:0:13232:0:(genops.c:885:class_export_put()) final put ffff93288f27b000/lustre-OST0001_UUID 00000020:00000080:0.0:1790772580.892604:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f27b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790772580.892611:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790772580.892740:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 12e36d38-efd9-4a85-b7c8-c9520302915a->MGS 00010000:00010000:0.0:1790772580.892760:0:13232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772580.892801:0:13232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772580.892808:0:13232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790772580.892811:0:13232:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790772580.892814:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790772580.892828:0:13232:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:0.0:1790772580.892832:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328813fd000/0xd3c7635991be12e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be12e9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772580.892856:0:13232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772580.892863:0:13232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772580.892868:0:13232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772580.892870:0:13232:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790772580.892871:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790772580.893083:0:13232:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff932888221000 00010000:00010000:0.0:1790772580.893087:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932881519e00/0xd3c7635991be1520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd3c7635991be1527 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790772580.893109:0:13232:0:(import.c:65:import_set_state_nolock()) ffff932888221000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790772580.893113:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790772580.893115:0:13232:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790772580.893117:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790772580.893121:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790772580.893133:0:13232:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9328bf51f800 x1877760813390592/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790772592 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790772580.893168:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790772580.893170:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000020:00000080:1.0:1790772580.894348:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f27f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1790772580.896152:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12e36d38-efd9-4a85-b7c8-c9520302915a:3314:1877760813390592:0@lo:250:kworker.0 10000000:01000000:0.0:1790772580.896245:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790772580.896260:0:13232:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be11c3 00000020:00000080:0.0:1790772580.896268:0:13232:0:(genops.c:885:class_export_put()) final put ffff932890714000/12e36d38-efd9-4a85-b7c8-c9520302915a 00000020:01000000:0.0:1790772580.897807:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.134@tcp (flags='') 00000020:00000080:0.0:1790772580.897820:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772580.897830:0:13232:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790772580.897834:0:13232:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff932894b719c0) has no exports 10000000:01000000:2.0:1790772580.898145:0:5852:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790772580.898707:0:13232:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.201.134@tcp: client import never connected 00000100:00080000:0.0:1790772580.898712:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790772580.898716:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790772580.898719:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790772580.898722:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790772580.898802:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff932890714000/12e36d38-efd9-4a85-b7c8-c9520302915a for MGC192.168.201.134@tcp 00000020:00000080:0.0:1790772580.909759:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772580.909774:0:13232:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.134@tcp (uuid 12e36d38-efd9-4a85-b7c8-c9520302915a) 00000020:01000000:0.0:1790772580.909782:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790772580.909789:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772580.909794:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790772580.909802:0:13232:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93288f0a5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790772580.909810:0:13232:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff932894b70000) has exports, disconnecting them 00000020:00080000:0.0:1790772580.909815:0:13232:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93288f0a5800), last request at 1790772366 00000020:00000080:0.0:1790772580.909820:0:13232:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be13fa 00000020:00080000:0.0:1790772580.909847:0:13232:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93288f0a5800): rc 0 00000020:00000080:0.0:1790772580.909852:0:13232:0:(genops.c:885:class_export_put()) final put ffff93288f0a5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790772580.910563:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff932888221000 for MGC192.168.201.134@tcp 00000020:00000080:1.0:1790772580.910572:0:36:0:(genops.c:885:class_export_put()) final put ffff932888227800/12e36d38-efd9-4a85-b7c8-c9520302915a 00000020:00000080:1.0:1790772580.910588:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff932888227800/12e36d38-efd9-4a85-b7c8-c9520302915a for MGC192.168.201.134@tcp 00000020:01000000:1.0:1790772580.910594:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.134@tcp (12e36d38-efd9-4a85-b7c8-c9520302915a) 00000020:00000080:1.0:1790772580.910823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f0a5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1790772580.911720:0:13232:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790772580.911726:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772580.911730:0:13232:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790772580.911737:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790772580.911825:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1790772580.911967:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f27a800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1790772580.912106:0:8521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790772580.912161:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790772580.912308:0:5839:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff932883008c00:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1790772580.926363:0:5838:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff932884fd9c00:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1790772580.926547:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772580.926851:0:5842:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff932883008400:5842] 2 exiting: rc = 0 00000100:00100000:1.0:1790772580.928201:0:5840:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff932883008000:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1790772580.929187:0:8465:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9328bf6b4600:8465] 3 exiting: rc = 0 00000100:00100000:2.0:1790772580.937073:0:5841:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9328919aa800:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1790772580.937261:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937270:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937276:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937280:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937286:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937291:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937297:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937302:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937307:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937315:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937320:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937326:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937333:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937339:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937345:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937352:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937358:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937364:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937369:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937374:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937379:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937399:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937404:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937410:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937415:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937421:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937426:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937432:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937437:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937442:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937447:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937451:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937457:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937463:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937477:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937484:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937490:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937495:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937501:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937507:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937513:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937518:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937522:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937527:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937531:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937549:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937555:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937560:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937566:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937571:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937576:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937580:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937585:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937591:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937596:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937602:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937614:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937619:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937624:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937629:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937634:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937638:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937653:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.937668:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790772580.941160:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772580.941173:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790772580.941178:0:13232:0:(genops.c:885:class_export_put()) final put ffff93288f27c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790772580.941183:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff93288f27c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790772580.941189:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1790772580.941232:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328bb7d8800 1 00000020:00000080:1.0:1790772580.941238:0:13232:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be139f 00000020:00000080:1.0:1790772580.941245:0:13232:0:(genops.c:885:class_export_put()) final put ffff9328bf9be800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790772580.941419:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790772580.941425:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772580.941430:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790772580.941434:0:13232:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9328b9bf3380) has no exports 00000020:00000080:2.0:1790772580.941852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf9be800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790772580.970294:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772580.970311:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790772580.970317:0:13232:0:(genops.c:885:class_export_put()) final put ffff9328bb7da000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790772580.970322:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bb7da000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790772580.970334:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790772580.970505:0:13232:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9328bb7df800 00000020:01000000:1.0:1790772580.970531:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790772580.970536:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772580.970542:0:13232:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790772580.970548:0:13232:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9328ba5f4d40) has no exports 00000020:00000080:1.0:1790772580.970581:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772580.970590:0:13232:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790772580.970593:0:13232:0:(genops.c:885:class_export_put()) final put ffff9328b23bf800/OSS_uuid 00000020:00000080:1.0:1790772580.970606:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9328b23bf800/OSS_uuid for OSS 00000020:01000000:1.0:1790772580.970626:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1790772580.970655:0:5851:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1790772580.971159:0:6706:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9328c0b30800:6706] 2 exiting: rc = 0 00000100:00100000:1.0:1790772580.971574:0:6705:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9328b1798800:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1790772580.971634:0:6704:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9328b17d0000:6704] 0 exiting: rc = 1 00000100:00100000:1.0:1790772580.971699:0:12032:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9328b9b8da00:12032] 3 exiting: rc = 0 00000100:00100000:1.0:1790772580.972066:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972194:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972204:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972214:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972221:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972228:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972235:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972241:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972248:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972256:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972263:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972270:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972276:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972283:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972290:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972295:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972300:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972307:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972314:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972321:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972329:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972337:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972343:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972351:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972357:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972365:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972371:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972389:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972396:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972402:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972408:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972412:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972417:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972422:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972427:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972432:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972436:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972441:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972446:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972451:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972456:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972462:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972479:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972485:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972490:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972496:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972501:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972506:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972511:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972516:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972522:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972526:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972531:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972537:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972542:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972548:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972553:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972558:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972564:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972570:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972575:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972581:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972593:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.972599:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.975363:0:7727:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9328b9b8c800:7727] 2 exiting: rc = 0 00000100:00100000:1.0:1790772580.977042:0:6708:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9328c0b31000:6708] 1 exiting: rc = 0 00000100:00100000:2.0:1790772580.980007:0:6707:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9328c0b31c00:6707] 0 exiting: rc = 1 00000100:00100000:1.0:1790772580.980465:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980475:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980481:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980487:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980492:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980497:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980502:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980507:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980511:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980516:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980521:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980527:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980532:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980537:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980543:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980548:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980553:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980557:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980562:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980567:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980571:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980576:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980582:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980588:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980593:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980599:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980604:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980609:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980614:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980619:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980624:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980640:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980645:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980650:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980657:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980663:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980668:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980673:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980678:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980684:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980689:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980694:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980699:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980704:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980709:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980714:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980719:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980724:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980728:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980733:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980738:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980742:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980747:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980751:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980756:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980760:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980765:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980770:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980774:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980779:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980783:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980788:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980792:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.980797:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.984568:0:6711:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9328ba521200:6711] 2 exiting: rc = 0 00000100:00100000:2.0:1790772580.987115:0:6709:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9328ba522000:6709] 0 exiting: rc = 1 00000100:00100000:3.0:1790772580.990217:0:6710:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9328ba522200:6710] 1 exiting: rc = 0 00000100:00100000:1.0:1790772580.994089:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994117:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994123:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994130:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994135:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994140:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994148:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994153:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994158:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994164:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994171:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994176:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994182:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994187:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994206:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994213:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994218:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994225:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994231:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994237:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994243:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994249:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994254:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994260:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994265:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994270:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994275:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994279:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994285:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994290:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994295:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994300:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994306:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994311:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994316:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994321:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994334:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994341:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994360:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994366:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994372:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994377:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994383:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994388:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994393:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994399:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994405:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994411:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994416:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994421:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994427:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994432:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994438:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994443:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994448:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994454:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994460:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994465:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994471:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994477:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994482:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994489:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994495:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772580.994501:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.010175:0:6712:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9328ba521a00:6712] 0 exiting: rc = 1 00000100:00100000:3.0:1790772581.015085:0:6713:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9328aa8fb200:6713] 1 exiting: rc = 0 00000100:00100000:1.0:1790772581.015328:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015337:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015342:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015347:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015353:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015357:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015362:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015381:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015387:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015393:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015399:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015404:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015409:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015414:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015419:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015424:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015428:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015433:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015439:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015443:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015449:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015454:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015459:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015463:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015468:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015475:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015480:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015485:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015491:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015495:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015501:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015507:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015515:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015521:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015528:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015535:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015542:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015557:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015566:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015572:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015577:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015583:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015596:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015601:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015606:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015612:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015617:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015622:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015627:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015632:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015637:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015647:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015654:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015659:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015664:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015669:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015674:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015679:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015683:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015688:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015693:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015698:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015704:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.015709:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772581.017400:0:6714:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9328ba521800:6714] 0 exiting: rc = 1 00000100:00100000:2.0:1790772581.017523:0:6715:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9328ba521c00:6715] 1 exiting: rc = 0 00000100:00100000:2.0:1790772581.017579:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017587:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017593:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017600:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017606:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017611:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017617:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017623:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017629:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017645:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017652:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017657:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017665:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017671:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017676:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017681:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017686:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017691:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017697:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017702:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017718:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017737:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017744:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017750:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017756:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017762:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017767:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017774:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017780:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017787:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017794:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017800:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.017806:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.019778:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.019807:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.019813:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.019820:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020111:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020119:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020126:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020132:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020137:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020143:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020148:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020154:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020180:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020187:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020192:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020198:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020204:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020210:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020215:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020220:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020226:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020231:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020249:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020255:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020275:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020282:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020474:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020481:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020488:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020494:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772581.020500:0:13232:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790772581.037600:0:13232:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790772599.134954:0:13847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790772607.740997:0:14307:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790772607.741002:0:14307:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790772607.741210:0:14307:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93288694b000 00000020:01000004:0.0:1790772607.741226:0:14307:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790772607.741235:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790772607.741253:0:14307:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff932894b74d40) 00000020:00000080:0.0:1790772607.741267:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790772607.760731:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790772607.763629:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1790772607.764353:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 353: rc = 0 00100000:10000000:0.0:1790772607.764464:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 353: rc = 0 00100000:10000000:0.0:1790772607.764609:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 353: rc = 0 00100000:10000000:0.0:1790772607.765166:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790772607.765244:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 353: rc = 0 00100000:10000000:0.0:1790772607.765383:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 353: rc = 0 00100000:10000000:0.0:1790772607.765483:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 353: rc = 0 00100000:10000000:0.0:1790772607.765819:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 355: rc = 0 00100000:10000000:0.0:1790772607.767535:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:0.0:1790772607.767642:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:0.0:1790772607.768393:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:0.0:1790772607.768806:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:0.0:1790772607.769337:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:0.0:1790772607.769612:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:0.0:1790772607.770187:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:0.0:1790772607.770451:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:0.0:1790772607.770719:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:0.0:1790772607.771523:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:0.0:1790772607.771871:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:0.0:1790772607.772483:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:0.0:1790772607.772771:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:0.0:1790772607.773087:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:0.0:1790772607.773516:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 379: rc = 0 00100000:10000000:0.0:1790772607.773789:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 379: rc = 0 00100000:10000000:0.0:1790772607.774062:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 379: rc = 0 00100000:10000000:0.0:1790772607.774302:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 379: rc = 0 00100000:10000000:0.0:1790772607.774547:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 379: rc = 0 00100000:10000000:0.0:1790772607.774820:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 379: rc = 0 00100000:10000000:0.0:1790772607.775633:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 379: rc = 0 00100000:10000000:0.0:1790772607.776166:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 379: rc = 0 00100000:10000000:0.0:1790772607.776408:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 379: rc = 0 00100000:10000000:0.0:1790772607.776652:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 379: rc = 0 00100000:10000000:0.0:1790772607.777259:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 379: rc = 0 00100000:10000000:0.0:1790772607.777522:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 379: rc = 0 00100000:10000000:0.0:1790772607.778136:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 379: rc = 0 00100000:10000000:0.0:1790772607.778430:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 379: rc = 0 00100000:10000000:0.0:1790772607.778690:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 379: rc = 0 00100000:10000000:0.0:1790772607.779436:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 379: rc = 0 00100000:10000000:0.0:1790772607.779683:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 379: rc = 0 00100000:10000000:0.0:1790772607.780233:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 379: rc = 0 00100000:10000000:0.0:1790772607.780494:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 379: rc = 0 00100000:10000000:0.0:1790772607.780724:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 379: rc = 0 00100000:10000000:0.0:1790772607.781392:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 379: rc = 0 00100000:10000000:0.0:1790772607.781660:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 379: rc = 0 00100000:10000000:0.0:1790772607.781976:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 379: rc = 0 00100000:10000000:0.0:1790772607.782215:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 379: rc = 0 00100000:10000000:0.0:1790772607.782455:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 379: rc = 0 00100000:10000000:0.0:1790772607.782693:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 379: rc = 0 00100000:10000000:0.0:1790772607.785578:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 379: rc = 0 00100000:10000000:0.0:1790772607.786036:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 379: rc = 0 00100000:10000000:0.0:1790772607.786318:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 379: rc = 0 00100000:10000000:0.0:1790772607.786603:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 379: rc = 0 00100000:10000000:0.0:1790772607.786870:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 379: rc = 0 00100000:10000000:0.0:1790772607.787154:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 379: rc = 0 00100000:10000000:0.0:1790772607.787546:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 657: rc = 0 00100000:10000000:0.0:1790772607.788019:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1790772607.788170:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1790772607.788346:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1790772607.789650:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1790772607.790169:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1790772607.790236:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1790772607.790614:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1790772607.790689:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 116: rc = 0 00100000:10000000:0.0:1790772607.791195:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1790772607.791268:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 116: rc = 0 00100000:10000000:0.0:1790772607.791479:0:14307:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1790772607.791538:0:14307:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 116: rc = 0 00000020:00000080:0.0:1790772607.792189:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790772607.792198:0:14307:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790772607.792209:0:14307:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be24b6 00000020:01000004:0.0:1790772607.792216:0:14307:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1790772607.792222:0:14307:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790772607.792227:0:14307:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93288694b000 from MGS 00000020:01000004:0.0:1790772607.792231:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790772607.792241:0:14307:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff932894b73380) 00000020:00000080:0.0:1790772607.792250:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790772607.792302:0:14307:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93288694b000 from MGS, refs=2 00080000:01000000:0.0:1790772607.792314:0:14307:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790772607.792321:0:14307:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be24c4 00000100:00100000:0.0:1790772607.792431:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790772607.792552:0:14307:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790772607.792558:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790772607.793412:0:14307:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790772607.793420:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790772607.794287:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772607.794461:0:14307:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790772607.794467:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790772607.795300:0:14307:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790772607.795307:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790772607.795660:0:14307:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790772607.795666:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790772607.796482:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772607.796485:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772607.796486:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772607.796809:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772607.796812:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772607.796813:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772607.797514:0:14307:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790772607.801941:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790772607.811398:0:14307:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790772607.811419:0:14307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790772607.811422:0:14307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790772607.813453:0:14316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790772607.813615:0:14307:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790772607.813718:0:14307:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790772607.814330:0:14307:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790772607.814642:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772607.815122:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790772607.815130:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790772607.824141:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790772607.824153:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790772607.824512:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790772607.824518:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790772607.825510:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790772607.825531:0:14307:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:2.0:1790772607.825532:0:14307:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790772607.825563:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:2.0:1790772607.825575:0:14307:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (ffff9328882f0000) 00000020:00000080:2.0:1790772607.825590:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790772607.825662:0:14307:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9328c109e800@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1790772607.826039:0:14307:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:2.0:1790772607.826046:0:14307:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790772607.826607:0:14322:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790772607.826676:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid d178e578-a8f2-4768-8767-0ddb2fe17697) 00000020:00000080:1.0:1790772607.826692:0:14307:0:(genops.c:1384:class_connect()) connect: client d178e578-a8f2-4768-8767-0ddb2fe17697, cookie 0xd3c7635991be24d2 00000100:00080000:1.0:1790772607.826702:0:14307:0:(import.c:545:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772607.826710:0:14307:0:(import.c:666:import_select_connection()) MGC192.168.201.134@tcp: import ffff9328c109e800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772607.826757:0:14307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf628a80 x1877760813390976/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772607.826780:0:14307:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d178e578-a8f2-4768-8767-0ddb2fe17697->MGS 00000020:01000004:1.0:1790772607.826796:0:14307:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790772607.826800:0:14307:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790772607.826809:0:14307:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9328ba5f0000) 00000020:00000080:1.0:1790772607.826818:0:14307:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790772607.826959:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d178e578-a8f2-4768-8767-0ddb2fe17697:3314:1877760813390976:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790772607.827026:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772607.827386:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813390976 00000100:00100000:0.0:1790772607.827394:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813390976 00000100:00100000:0.0:1790772607.827428:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772607.827436:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c14a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1877760813390976:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790772607.827460:0:14317:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d178e578-a8f2-4768-8767-0ddb2fe17697@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1790772607.827483:0:14317:0:(genops.c:1384:class_connect()) connect: client d178e578-a8f2-4768-8767-0ddb2fe17697, cookie 0xd3c7635991be24e0 00000100:00080000:0.0:1790772607.827600:0:14317:0:(import.c:65:import_set_state_nolock()) ffff9328bf6cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772607.827663:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c14a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+5:3314:x1877760813390976:12345-0@lo:250:mount.lustre.0 Request processed in 226us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772607.827671:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790772607.827719:0:14321:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1790772607.828021:0:3314:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790772607.828029:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:2.0:1790772607.828044:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790772607.828048:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790772607.828051:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9328c109e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790772607.828066:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790772607.828078:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790772607.828083:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d178e578-a8f2-4768-8767-0ddb2fe17697:3314:1877760813390976:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790772607.841640:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772607.841799:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790772607.841806:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790772607.843054:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790772607.843063:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790772607.843663:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790772607.843671:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790772607.844462:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772607.844628:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790772607.844634:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790772607.845123:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790772607.845130:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790772607.872378:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772607.872597:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790772607.872604:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790772607.873958:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790772607.873968:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790772607.874390:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772607.874545:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772607.874550:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790772607.877385:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790772607.877398:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790772607.877990:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772607.878170:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772607.878175:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790772607.882279:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772607.882291:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790772607.883034:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772607.883207:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790772607.883213:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790772607.883793:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772607.883802:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790772607.896359:0:14307:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772607.896605:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790772607.896612:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790772607.898101:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790772607.898114:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790772607.898943:0:14307:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790772607.898953:0:14307:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790772607.899672:0:14307:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790772607.899696:0:14307:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790772607.899703:0:14307:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790772607.900026:0:14307:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790772607.900068:0:14307:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790772607.900072:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790772607.900074:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790772607.900075:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772607.900076:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772607.900077:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772607.900079:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772607.900080:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772607.900082:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790772607.900084:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772607.900085:0:14307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790772607.900088:0:14307:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790772607.900090:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772607.900091:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790772607.900092:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772607.900093:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772607.900094:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772607.900095:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772607.900096:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772607.900098:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790772607.900098:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772607.900100:0:14307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790772607.900127:0:14307:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790772607.900146:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790772607.900218:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772607.900297:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff932899ed96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772607.900354:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391104 00000100:00100000:1.0:1790772607.900362:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391104 00000100:00100000:1.0:1790772607.900441:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772607.900450:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c14a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+5:14307:x1877760813391104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772607.900490:0:14320:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790772607.900496:0:14320:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790772607.900499:0:14320:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790772607.900928:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790772607.901248:0:14320:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1790772607.902298:0:14342:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790772607.902305:0:14342:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790772607.902308:0:14342:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790772607.902337:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790772607.902636:0:14320:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790772607.902647:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790772607.916513:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c14a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+5:14307:x1877760813391104:12345-0@lo:253:mount.lustre.0 Request processed in 16053us (16283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772607.916529:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772607.916629:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391104:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790772607.916646:0:14307:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790772607.916649:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772607.916651:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790772607.916652:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772607.916654:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772607.916655:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772607.916656:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772607.916658:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790772607.916659:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790772607.916661:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772607.916662:0:14307:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790772607.916683:0:14307:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93288694b000 from lustre-MDT0000 10000000:01000000:1.0:1790772607.916710:0:14307:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790772607.916714:0:14307:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790772607.916718:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9328882f0000 10000000:01000000:1.0:1790772607.916722:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772607.916730:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9328882f0000 from 1 10000000:01000000:1.0:1790772607.916817:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790772607.916860:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.916871:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.917025:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772607.917046:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772607.917102:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772607.917190:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772607.917361:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391232 00000100:00100000:0.0:1790772607.917453:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391232 00000100:00100000:0.0:1790772607.917548:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772607.917557:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c14a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+5:14307:x1877760813391232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772607.917572:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772607.917590:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93289ed93200/0xd3c7635991be24ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be24e7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772607.917614:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed93200/0xd3c7635991be24ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be24e7 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772607.917626:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93289ed93200/0xd3c7635991be24ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be24e7 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772607.917635:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93200, rc 0) 00000100:00100000:0.0:1790772607.917680:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c14a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+6:14307:x1877760813391232:12345-0@lo:101:mount.lustre.0 Request processed in 125us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772607.917687:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772607.917768:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772607.917783:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.917792:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772607.917840:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772607.917870:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772607.918133:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772607.918309:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391360 00000100:00100000:2.0:1790772607.918314:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391360 00000100:00100000:2.0:1790772607.918339:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772607.918345:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+6:14307:x1877760813391360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772607.918649:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+6:14307:x1877760813391360:12345-0@lo:501:mount.lustre.0 Request processed in 303us (777us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772607.918657:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772607.918759:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391360:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790772607.918783:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790772607.918801:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.918810:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772607.918818:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93288694b000 10000000:01000000:1.0:1790772607.918823:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790772607.918827:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93288694b000 10000000:01000000:1.0:1790772607.918829:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790772607.918832:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93288694b000 from 1 10000000:01000000:1.0:1790772607.918834:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790772607.918853:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.918866:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.918889:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772607.918904:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772607.918931:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772607.918943:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772607.919065:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391488 00000100:00100000:2.0:1790772607.919069:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391488 00000100:00100000:2.0:1790772607.919088:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772607.919094:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+6:14307:x1877760813391488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772607.919102:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772607.919120:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974c400/0xd3c7635991be24fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be24f5 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772607.919150:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974c400/0xd3c7635991be24fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be24f5 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772607.919160:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974c400/0xd3c7635991be24fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be24f5 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772607.919168:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974c400, rc 0) 00000100:00100000:2.0:1790772607.919204:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+7:14307:x1877760813391488:12345-0@lo:101:mount.lustre.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772607.919210:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772607.919399:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772607.919412:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24fc expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.919420:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be24fc expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772607.919430:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790772607.919445:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24fc expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.919451:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880031e00/0xd3c7635991be24f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24fc expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772607.919457:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790772607.919461:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772607.919465:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93288694b000 10000000:01000000:1.0:1790772607.919467:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790772607.919476:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790772607.919478:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772607.919493:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.919500:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.919507:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772607.919519:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772607.919544:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772607.919563:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772607.919684:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391616 00000100:00100000:2.0:1790772607.919689:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391616 00000100:00100000:2.0:1790772607.919707:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772607.919713:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+7:14307:x1877760813391616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772607.919719:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772607.919727:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974ce00/0xd3c7635991be250a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2503 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772607.919810:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974ce00/0xd3c7635991be250a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2503 expref: 8 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772607.919818:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974ce00/0xd3c7635991be250a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2503 expref: 8 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772607.919825:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974ce00, rc 0) 00000100:00100000:2.0:1790772607.919859:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+8:14307:x1877760813391616:12345-0@lo:101:mount.lustre.0 Request processed in 146us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772607.919894:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772607.920026:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772607.920039:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be250a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772607.920047:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be250a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772607.920088:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772607.920114:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772607.920225:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391744 00000100:00100000:2.0:1790772607.920230:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391744 00000100:00100000:2.0:1790772607.920271:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772607.920277:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+8:14307:x1877760813391744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772607.921029:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14307:x1877760813391744:12345-0@lo:501:mount.lustre.0 Request processed in 750us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772607.921038:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772607.921130:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772607.921222:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772607.921317:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772607.921358:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772607.921495:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf6a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772607.921626:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813391872 00000100:00100000:3.0:1790772607.921633:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813391872 00000100:00100000:0.0:1790772607.921684:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772607.921695:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14307:x1877760813391872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772607.922255:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813391872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772607.922458:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14307:x1877760813391872:12345-0@lo:503:mount.lustre.0 Request processed in 765us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772607.922465:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772607.922966:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14343:1877760813392000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772607.923011:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772607.923053:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891b1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772607.923225:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813392000 00000100:00100000:1.0:1790772607.923232:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813392000 00000100:00100000:1.0:1790772607.923278:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772607.923286:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14343:x1877760813392000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772607.923859:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14343:x1877760813392000:12345-0@lo:502:llog_process_th.0 Request processed in 572us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772607.923867:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772607.925575:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14343:1877760813392000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772607.925612:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772607.925631:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772607.925634:0:14343:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790772607.925642:0:14343:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790772607.925645:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772607.925661:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff932894b70000) 00000020:00000080:0.0:1790772607.925680:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790772607.925685:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790772607.925848:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790772607.925856:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be2518 00000020:00000080:0.0:1790772607.926086:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790772607.926091:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772607.926095:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772607.926096:0:14343:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790772607.926099:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772607.926103:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772607.926105:0:14343:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790772607.926108:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772607.926115:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff932894b719c0) 00000020:00000080:0.0:1790772607.926126:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790772607.926130:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790772607.926132:0:14343:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790772607.926135:0:14343:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790772607.926141:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790772607.926177:0:14343:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93288694b000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790772607.926197:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9328bfbc4d40) 00000020:00000080:0.0:1790772607.926205:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790772607.926324:0:14343:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790772607.926329:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be252d 00000020:00000080:0.0:1790772607.926627:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790772607.926634:0:14343:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790772607.926639:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd3c7635991be2534 00080000:01000000:0.0:1790772607.926646:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790772607.926649:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be253b 00010000:00010000:1.0:1790772607.991981:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790772607.992378:0:14343:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1790772607.992545:0:14343:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790772607.993050:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9328ba5f4d40) 00000020:00000080:1.0:1790772607.993068:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790772607.993127:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790772607.993133:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be2549 00000020:00000080:3.0:1790772607.994479:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790772608.001541:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd3c7635991be2550 00000020:00000080:1.0:1790772608.002257:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790772608.002269:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772608.002276:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.002278:0:14343:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790772608.002283:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772608.002289:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.002291:0:14343:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790772608.002296:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790772608.002334:0:14343:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790772608.002354:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772608.002358:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.002359:0:14343:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790772608.002361:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790772608.002868:0:14343:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1790772608.002869:0:14343:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772608.007263:0:14343:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772608.007278:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790772608.007317:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.007320:0:14343:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790772608.007327:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790772608.007334:0:14343:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790772608.007338:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.007339:0:14343:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790772608.007343:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790772608.007348:0:14343:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:1.0:1790772608.007412:0:14343:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790772608.007416:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772608.007433:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9328ba5f3380) 00000020:00000080:1.0:1790772608.007457:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790772608.007463:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790772608.007541:0:14343:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790772608.007547:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790772608.007556:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be255e 00010000:00080000:1.0:1790772608.007585:0:14343:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9328b8d5a000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1790772608.007806:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1790772608.008211:0:14343:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790772608.008250:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790772608.009217:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772608.009281:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790772608.009350:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790772608.014091:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790772608.014100:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790772608.016299:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772608.016314:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790772608.016349:0:14343:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790772608.016395:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be2565 00000100:00080000:1.0:1790772608.016407:0:14343:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772608.016432:0:14343:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9328b8d5a000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772608.016470:0:14343:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf62bb80 x1877760813392128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772608.016497:0:14343:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1790772608.016535:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813392128:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790772608.016613:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760813392128 offset 0 length 520: 4 00000020:01000000:1.0:1790772608.017003:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772608.017007:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.017009:0:14343:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790772608.017012:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790772608.017015:0:14343:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1790772608.017016:0:14343:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772608.017018:0:14343:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772608.017019:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790772608.017022:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.017023:0:14343:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790772608.017025:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790772608.017030:0:14343:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790772608.017034:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.017035:0:14343:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790772608.017038:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790772608.017042:0:14343:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:1.0:1790772608.017064:0:14343:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790772608.017067:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772608.017079:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9328ba5f19c0) 00000020:00000080:1.0:1790772608.017093:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790772608.017098:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790772608.017169:0:14343:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790772608.017173:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790772608.017178:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd3c7635991be2573 00010000:00080000:1.0:1790772608.017205:0:14343:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932894ae3000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1790772608.017405:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790772608.017601:0:14343:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790772608.017636:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790772608.019945:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772608.020019:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1790772608.020088:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1790772608.026511:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790772608.026530:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790772608.027350:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772608.027363:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790772608.027408:0:14343:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790772608.027428:0:14343:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be257a 00000100:00080000:1.0:1790772608.027440:0:14343:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772608.027452:0:14343:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932894ae3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772608.027489:0:14343:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf62b800 x1877760813392256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772608.027551:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813392256:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790772608.027605:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760813392256 offset 0 length 520: 4 00000100:00080000:1.0:1790772608.027661:0:14343:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790772608.027766:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772608.027770:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.027772:0:14343:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790772608.027775:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772608.027779:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.027780:0:14343:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790772608.027783:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790772608.027784:0:14343:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790772608.027786:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772608.027788:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.027790:0:14343:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790772608.027792:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772608.027793:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.027794:0:14343:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790772608.027798:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790772608.027829:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14343:1877760813392384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772608.027903:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772608.027933:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813392384 00000100:00100000:1.0:1790772608.027945:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813392384 00000100:00100000:1.0:1790772608.027983:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772608.027991:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14343:x1877760813392384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772608.028210:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14343:x1877760813392384:12345-0@lo:502:llog_process_th.0 Request processed in 219us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772608.028219:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772608.028260:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059300 going to sleep for 11 seconds 00000100:00100000:1.0:1790772608.028280:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14343:1877760813392384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772608.028302:0:14343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772608.028306:0:14343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772608.028308:0:14343:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790772608.028312:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1790772608.028381:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1790772608.028403:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790772608.028422:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be250a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.028432:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030200/0xd3c7635991be2503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be250a expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772608.028440:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93288694b000 from 1 10000000:01000000:1.0:1790772608.028443:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790772608.028469:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.028477:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.028486:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772608.028505:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772608.028532:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772608.028549:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059300 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.029257:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813392512 00000100:00100000:3.0:1790772608.029265:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813392512 00000100:00100000:3.0:1790772608.029343:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772608.029351:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+9:14307:x1877760813392512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772608.029374:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772608.029393:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2581 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.029415:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2581 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.029427:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2581 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.029435:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8e00, rc 0) 00000100:00100000:3.0:1790772608.029494:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+10:14307:x1877760813392512:12345-0@lo:101:mount.lustre.0 Request processed in 143us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772608.029500:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772608.029574:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772608.029591:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.029599:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772608.030261:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392640:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790772608.030307:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.030686:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1766480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772608.031084:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813392640 00000100:00100000:1.0:1790772608.031092:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813392640 00000100:00100000:1.0:1790772608.031132:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772608.031141:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+10:14307:x1877760813392640:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790772608.031162:0:14317:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790772608.031167:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790772608.031249:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+10:14307:x1877760813392640:12345-0@lo:256:mount.lustre.0 Request processed in 110us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772608.031258:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772608.031380:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392640:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790772608.032011:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790772608.032029:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.032040:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772608.032048:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93288694b000 from 1 10000000:01000000:2.0:1790772608.032050:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790772608.032082:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.032090:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.032100:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772608.032118:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772608.032154:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.032180:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1766480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772608.032280:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813392768 00000100:00100000:1.0:1790772608.032286:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813392768 00000100:00100000:1.0:1790772608.032309:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772608.032315:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+10:14307:x1877760813392768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772608.032325:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772608.032339:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be258f expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.032360:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be258f expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.032381:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be258f expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.032390:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030000, rc 0) 00000100:00100000:1.0:1790772608.032438:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813392768:12345-0@lo:101:mount.lustre.0 Request processed in 122us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772608.032444:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772608.032525:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772608.032537:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.032546:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772608.032601:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772608.032633:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.032657:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1766480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772608.033097:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813392896 00000100:00100000:1.0:1790772608.033102:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813392896 00000100:00100000:1.0:1790772608.033122:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772608.033129:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813392896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772608.033537:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813392896:12345-0@lo:501:mount.lustre.0 Request processed in 407us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772608.033544:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772608.034035:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813392896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772608.034077:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772608.034119:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.034150:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1766480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772608.034272:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393024 00000100:00100000:1.0:1790772608.034277:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393024 00000100:00100000:1.0:1790772608.034300:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772608.034307:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813393024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772608.034468:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813393024:12345-0@lo:503:mount.lustre.0 Request processed in 160us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772608.034474:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772608.034647:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772608.035092:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14351:1877760813393152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772608.035133:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.035161:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1766600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772608.035646:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393152 00000100:00100000:1.0:1790772608.035653:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393152 00000100:00100000:1.0:1790772608.035740:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772608.035749:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14351:x1877760813393152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772608.035990:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14351:x1877760813393152:12345-0@lo:502:llog_process_th.0 Request processed in 242us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772608.035999:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772608.036157:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14351:1877760813393152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772608.036185:0:14351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772608.036195:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772608.036197:0:14351:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790772608.036206:0:14351:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93288694b000 00000020:00000080:2.0:1790772608.036208:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772608.036219:0:14351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772608.036221:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772608.036223:0:14351:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790772608.036225:0:14351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772608.036227:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772608.036229:0:14351:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790772608.036232:0:14351:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93288694b000 00000020:00000080:2.0:1790772608.036234:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772608.036307:0:14351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772608.037982:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772608.037989:0:14351:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790772608.037998:0:14351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772608.038008:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772608.038010:0:14351:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772608.038015:0:14351:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93288694b000 00000020:00000080:2.0:1790772608.038018:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790772608.042452:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14351:1877760813393280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772608.042554:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.046095:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.049965:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393280 00000100:00100000:3.0:1790772608.049983:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393280 00000100:00100000:3.0:1790772608.050042:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772608.050053:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14351:x1877760813393280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772608.050643:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14351:x1877760813393280:12345-0@lo:502:llog_process_th.0 Request processed in 589us (8087us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772608.050651:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772608.055730:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14351:1877760813393280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772608.055776:0:14351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772608.055785:0:14351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772608.055787:0:14351:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790772608.055791:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790772608.060176:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790772608.060211:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772608.060243:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060256:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772608.060318:0:14307:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790772608.060321:0:14307:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93288694b000 10000000:01000000:3.0:1790772608.060324:0:14307:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93288694b000 10000000:01000000:3.0:1790772608.060328:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772608.060335:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93288694b000 from 1 10000000:01000000:3.0:1790772608.060337:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772608.060388:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060397:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060408:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772608.060431:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772608.060505:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772608.060535:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.060581:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393408 00000100:00100000:3.0:1790772608.060589:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393408 00000100:00100000:3.0:1790772608.060639:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772608.060649:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813393408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772608.060663:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772608.060676:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8400/0xd3c7635991be25a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be259d expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060699:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8400/0xd3c7635991be25a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be259d expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060723:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e8400/0xd3c7635991be25a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be259d expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060731:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8400, rc 0) 00000100:00100000:3.0:1790772608.060772:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14307:x1877760813393408:12345-0@lo:101:mount.lustre.0 Request processed in 124us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772608.060778:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772608.060831:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772608.060844:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772608.060853:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be25a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772608.060923:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772608.060948:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772608.060962:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.060974:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393536 00000100:00100000:3.0:1790772608.060978:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393536 00000100:00100000:3.0:1790772608.060993:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772608.060998:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14307:x1877760813393536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772608.061239:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14307:x1877760813393536:12345-0@lo:501:mount.lustre.0 Request processed in 239us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772608.061247:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772608.061279:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772608.061314:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772608.061349:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772608.061362:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a19d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.061388:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393664 00000100:00100000:3.0:1790772608.061392:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393664 00000100:00100000:3.0:1790772608.061409:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772608.061414:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932899caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14307:x1877760813393664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772608.061552:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932899caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14307:x1877760813393664:12345-0@lo:503:mount.lustre.0 Request processed in 136us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772608.061558:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772608.061596:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813393664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772608.065940:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14356:1877760813393792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772608.066027:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772608.066072:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891b1b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.066656:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393792 00000100:00100000:3.0:1790772608.066665:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393792 00000100:00100000:3.0:1790772608.066750:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772608.066760:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932890770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14356:x1877760813393792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772608.067029:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932890770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14356:x1877760813393792:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772608.067037:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790772608.069034:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14356:1877760813393792:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790772608.069102:0:14356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790772608.069117:0:14356:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9328882f3380) 00000020:00000080:2.0:1790772608.069134:0:14356:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790772608.069212:0:14356:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93288694b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772608.069217:0:14356:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93288694b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772608.069219:0:14356:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93288694b000 4 00010000:00080000:2.0:1790772608.069246:0:14356:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93288f0e5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1790772608.072039:0:14356:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790772608.072238:0:14356:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790772608.072276:0:14356:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772608.072288:0:14356:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd3c7635991be25b2 00000100:00080000:2.0:1790772608.072299:0:14356:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772608.072310:0:14356:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93288f0e5000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1790772608.072346:0:14356:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf51f800 x1877760813393920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772608.072416:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813393920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790772608.072487:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772608.072543:0:14356:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790772608.072732:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14356:1877760813394048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772608.072777:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.072804:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394048 00000100:00100000:2.0:1790772608.072811:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394048 00000100:00100000:2.0:1790772608.072847:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772608.072855:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932890773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14356:x1877760813394048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772608.073094:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932890773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14356:x1877760813394048:12345-0@lo:502:llog_process_th.0 Request processed in 239us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772608.073102:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772608.073136:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328900f7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772608.073152:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d178e578-a8f2-4768-8767-0ddb2fe17697:14356:1877760813394048:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790772608.073180:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1790772608.075606:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813393920 00000100:00100000:1.0:1790772608.075620:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813393920 00000100:00100000:1.0:1790772608.075666:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772608.075682:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1877760813393920:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772608.075770:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1877760813393920:12345-0@lo:38:llog_process_th.0 Request processed in 88us (3283us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790772608.075778:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1790772608.077194:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790772608.077229:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790772608.077245:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772608.077258:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8600/0xd3c7635991be259d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790772608.077314:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790772608.077316:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790772608.077317:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772608.077318:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772608.077319:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772608.077321:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772608.077323:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790772608.077324:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790772608.077326:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772608.077328:0:14307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772608.077332:0:14307:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790772608.077334:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772608.077335:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790772608.077336:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772608.077337:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772608.077338:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772608.077339:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772608.077341:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790772608.077342:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790772608.077343:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772608.077344:0:14307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790772608.077382:0:14307:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790772608.077399:0:14307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813394176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790772608.077472:0:14307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772608.077508:0:14307:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f059540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772608.079372:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394176 00000100:00100000:3.0:1790772608.079387:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394176 00000100:00100000:3.0:1790772608.079447:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790772608.079456:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14307:x1877760813394176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790772608.079507:0:14320:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790772608.079522:0:14320:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790772608.081283:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790772608.081296:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93288f0e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772608.081302:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790772608.081307:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813393920:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1790772608.132016:0:14320:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790772608.132029:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790772608.132050:0:14341:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790772608.132054:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790772608.132075:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.132112:0:14341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2581 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.132121:0:14341:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.132162:0:14341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be2581 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.132176:0:14341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be2581 expref: 12 pid: 14320 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772608.132192:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14341:1877760813394304:0@lo:104: 00000100:00100000:2.0:1790772608.133384:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.133563:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328900f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1790772608.133608:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394304 00000100:00100000:2.0:1790772608.133617:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394304 00000100:00100000:2.0:1790772608.133718:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772608.133739:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14341:x1877760813394304:12345-0@lo:104: 00010000:00010000:2.0:1790772608.133756:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.133820:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772608.133827:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14341:x1877760813394304:12345-0@lo:104: Request processed in 101us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772608.133847:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790772608.134729:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1790772608.134852:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14341:1877760813394304:0@lo:104: 00010000:00010000:3.0:1790772608.134909:0:14341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.135114:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.135123:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932880030400 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772608.135128:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.135136:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772608.135144:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772608.135150:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772608.135196:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.135202:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772608.135223:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.135229:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff932880030400/0xd3c7635991be2581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2588 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.135256:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772608.135264:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772608.135266:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772608.135287:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772608.135298:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813394432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772608.135353:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772608.138300:0:14310:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394432 00000100:00100000:2.0:1790772608.138316:0:14310:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394432 00010000:00010000:2.0:1790772608.138376:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2581 expref: 13 pid: 14320 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772608.138423:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772608.138433:0:14310:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+13:3316:x1877760813394432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772608.138449:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772608.138454:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2581 expref: 13 pid: 14320 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138467:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be2581 expref: 13 pid: 14320 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138484:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e8e00/0xd3c7635991be2588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be2581 expref: 13 pid: 14320 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138499:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138506:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772608.138521:0:14310:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006467262s 00010000:00010000:2.0:1790772608.138525:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138533:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138539:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138545:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138557:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772608.138562:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138570:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138591:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772608.138604:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772608.138682:0:14310:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:3316:x1877760813394432:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772608.138690:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790772608.138824:0:14341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.138831:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772608.138842:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328b974d800/0xd3c7635991be25b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772608.139103:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813394432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772608.150452:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14307:x1877760813394176:12345-0@lo:253:mount.lustre.0 Request processed in 70987us (72970us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772608.150468:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772608.150616:0:14307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:14307:1877760813394176:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790772608.150632:0:14307:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790772608.150635:0:14307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772608.150637:0:14307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790772608.150638:0:14307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772608.150639:0:14307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772608.150641:0:14307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772608.150642:0:14307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772608.150643:0:14307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790772608.150645:0:14307:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790772608.150647:0:14307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772608.150648:0:14307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790772608.150665:0:14307:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790772608.158147:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790772608.158494:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772608.159178:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772608.159544:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772608.160095:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772608.160336:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772608.161541:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772608.162331:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790772608.163114:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772608.163509:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772608.164397:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772608.164725:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1790772608.213041:0:14307:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1790772608.213987:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790772608.214319:0:14362:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790772608.214324:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1790772608.214616:0:14363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1790772608.214710:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772608.220205:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790772608.220276:0:14363:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790772608.220280:0:14363:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1790772608.227145:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790772608.227316:0:14307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790772608.228716:0:14307:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790772608.228808:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790772608.229336:0:14307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772608.230547:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790772608.231714:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790772608.232267:0:14307:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1790772608.239427:0:14307:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1790772608.274259:0:14307:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790772608.323031:0:14307:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790772608.323091:0:14307:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7e0c1c5f988 00100000:10000000:2.0:1790772608.323100:0:14307:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790772608.324509:0:14307:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772608.324527:0:14307:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772608.324609:0:14307:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790772608.324633:0:14307:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1790772608.844307:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772609.101201:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1790772609.356238:0:14322:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772609.356246:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93288694b000 from 6 10000000:01000000:2.0:1790772609.356252:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772609.356300:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772609.356313:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772609.356325:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772609.356361:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813394560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772609.356444:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772609.356491:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772609.356624:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394560 00000100:00100000:1.0:1790772609.356633:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394560 00000100:00100000:1.0:1790772609.356687:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772609.356697:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14322:x1877760813394560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772609.356722:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772609.356736:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be25c0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772609.356759:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772609.356770:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772609.356779:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932880030600, rc 0) 00000100:00100000:1.0:1790772609.356829:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813394560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772609.356836:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790772609.356965:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813394560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772609.356980:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772609.356989:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772609.357040:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813394688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772609.357075:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772609.357111:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b1553cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772609.357220:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394688 00000100:00100000:1.0:1790772609.357225:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394688 00000100:00100000:1.0:1790772609.357257:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772609.357263:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813394688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790772609.357277:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772609.357293:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772609.357296:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790772609.357398:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813394688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772609.357406:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772609.357437:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813394688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790772609.357479:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772609.357485:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772609.357498:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772609.866963:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772610.126568:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790772610.891285:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772611.916562:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772612.942521:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772613.216652:0:14606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1790772613.333570:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772613.333578:0:12655:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772613.333581:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772613.333584:0:12655:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772613.333587:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790772613.333590:0:12655:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790772613.333593:0:12655:0:(import.c:65:import_set_state_nolock()) ffff93288f0e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772613.333611:0:12655:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93288f0e5000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772613.333635:0:12655:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf629c00 x1877760813394944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772613.334036:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813394816:0@lo:400:kworker.0 00000100:00100000:2.0:1790772613.334128:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772613.334224:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394816 00000100:00100000:2.0:1790772613.334231:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394816 00000100:00100000:2.0:1790772613.334283:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772613.334293:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:3316:x1877760813394816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772613.334348:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:3316:x1877760813394816:12345-0@lo:400:kworker.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772613.334355:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772613.334404:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813394816:0@lo:400:kworker.0 00000100:00100000:3.0:1790772613.335586:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813394944:0@lo:38:kworker.0 00000100:00100000:3.0:1790772613.335677:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772613.335771:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813394944 00000100:00100000:2.0:1790772613.335779:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813394944 00000100:00100000:2.0:1790772613.335815:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772613.335822:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1877760813394944:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790772613.335849:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1790772613.335908:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd3c7635991be25ce 00000004:00100000:2.0:1790772613.335923:0:14327:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790772613.336070:0:14327:0:(import.c:65:import_set_state_nolock()) ffff9328ba5ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772613.336120:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877760813394944:12345-0@lo:38:kworker.0 Request processed in 297us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772613.336127:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790772613.336300:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9328bf629c00 x1877760813394944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772613.336315:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790772613.336333:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790772613.336338:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790772613.336341:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93288f0e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790772613.336347:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877760813394944:0@lo:38:kworker.0 00010000:00010000:1.0:1790772613.965187:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772614.987364:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772616.018406:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790772616.564103:0:14757:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe36896be0 20000000:00000080:2.0:1790772616.564119:0:14757:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93288fdf4800 uarg=0000000000000000 20000000:01000000:2.0:1790772616.564154:0:14757:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790772616.564160:0:14757:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790772616.564166:0:14757:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790772616.565441:0:14758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1790772616.565674:0:14757:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790772616.574069:0:14757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790772616.574414:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.574435:0:14757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be258f expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.574462:0:14757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.574508:0:14757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be258f expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.574524:0:14757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be258f expref: 11 pid: 14317 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772616.574540:0:14757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14757:1877760813395072:0@lo:104: 00000100:00100000:0.0:1790772616.574618:0:14757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772616.574669:0:14757:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886300b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772616.578097:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813395072 00000100:00100000:2.0:1790772616.578109:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813395072 00000100:00100000:2.0:1790772616.578315:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772616.578326:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14757:x1877760813395072:12345-0@lo:104: 00010000:00010000:2.0:1790772616.578346:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.578561:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772616.578567:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14757:x1877760813395072:12345-0@lo:104: Request processed in 244us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772616.578591:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1790772616.578641:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772616.578647:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.578655:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974ca00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772616.578659:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.578668:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772616.578676:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772616.578681:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772616.578719:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.578735:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772616.578755:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.578762:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328b974ca00/0xd3c7635991be258f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2596 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772616.578776:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772616.578777:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772616.578779:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772616.578797:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772616.578807:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813395200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772616.578844:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772616.579303:0:14310:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813395200 00000100:00100000:2.0:1790772616.579309:0:14310:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813395200 00010000:00010000:2.0:1790772616.579329:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be258f expref: 12 pid: 14317 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772616.579360:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772616.579367:0:14310:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:3318:x1877760813395200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772616.579378:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772616.579383:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be258f expref: 12 pid: 14317 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579393:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be258f expref: 12 pid: 14317 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579410:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579418:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579432:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579438:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579444:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579449:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579461:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772616.579465:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579472:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579481:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772616.579490:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772616.579528:0:14310:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:3318:x1877760813395200:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772616.579535:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772616.579570:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813395200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772616.579919:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030000/0xd3c7635991be2596 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be258f expref: 11 pid: 14317 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772616.579932:0:14757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14757:1877760813395072:0@lo:104: 00010000:00010000:1.0:1790772616.579946:0:14757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772616.579954:0:14757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772616.579969:0:14757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772616.579975:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93289ed92800/0xd3c7635991be25d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772617.035611:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772618.059584:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790772618.250966:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790772618.250985:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93288694b000 from 10 10000000:01000000:2.0:1790772618.250990:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790772618.251040:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772618.251049:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772618.251060:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772618.251084:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813395328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772618.251184:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772618.251268:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772618.251741:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813395328 00000100:00100000:3.0:1790772618.251750:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813395328 00000100:00100000:3.0:1790772618.251804:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772618.251814:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+11:14322:x1877760813395328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772618.251827:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772618.251844:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be25dc expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772618.251866:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be25dc expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772618.251946:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be25dc expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772618.251956:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9a00, rc 0) 00000100:00100000:3.0:1790772618.252014:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813395328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772618.252021:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772618.252136:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813395328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772618.252153:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772618.252163:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772618.252241:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813395456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772618.252271:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772618.252301:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886300cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772618.252567:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813395456 00000100:00100000:3.0:1790772618.252572:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813395456 00000100:00100000:3.0:1790772618.252603:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772618.252611:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813395456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772618.252855:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813395456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772618.252869:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772618.253167:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813395456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772618.253216:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813395584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772618.253276:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772618.253308:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886300cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772618.253537:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813395584 00000100:00100000:3.0:1790772618.253542:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813395584 00000100:00100000:3.0:1790772618.253581:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790772618.253588:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813395584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772618.253746:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:14322:x1877760813395584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772618.253753:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790772618.254084:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813395584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790772618.262894:0:14819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790772618.263346:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790772618.263372:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772618.263387:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772618.263398:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772618.443518:0:3314:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772608/real 1790772608] req@ffff9328bf62b800 x1877760813392256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772618.443564:0:3314:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9328bf62b800 x1877760813392256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772618.443577:0:3314:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772608/real 1790772608] req@ffff9328bf62bb80 x1877760813392128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772618.443588:0:3314:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9328bf62bb80 x1877760813392128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772618.443611:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772618.443638:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772618.443642:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813392256:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790772618.443649:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9328b8d5a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772618.443655:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772618.443658:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813392128:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790772618.445684:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772618.445707:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790772618.445712:0:37:0:(import.c:65:import_set_state_nolock()) ffff9328b8d5a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772618.445723:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1790772618.445731:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790772618.445750:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9328b8d5a000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772618.445810:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf629500 x1877760813395712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772618.445846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772618.445850:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790772618.445852:0:37:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772618.445856:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1790772618.445859:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790772618.445864:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932894ae3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772618.445902:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf629880 x1877760813395840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772618.445988:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813395968:0@lo:400:kworker.0 00000100:00100000:2.0:1790772618.446070:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772618.446284:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813395968 00000100:00100000:1.0:1790772618.446296:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813395968 00000100:00100000:1.0:1790772618.446369:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772618.446401:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813395968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772618.446525:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813395968:12345-0@lo:400:kworker.0 Request processed in 126us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772618.446533:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790772618.446631:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9328bf62b100 x1877760813395968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772618.446648:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813395968:0@lo:400:kworker.0 00000100:00100000:3.0:1790772618.447223:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813395712:0@lo:8:kworker.0 00000400:00000100:3.0:1790772618.447997:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760813395712 offset 0 length 520: 4 00000100:00100000:3.0:1790772618.448051:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813395840:0@lo:8:kworker.0 00000400:00000100:3.0:1790772618.448077:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760813395840 offset 0 length 520: 4 00010000:00010000:3.0:1790772619.084391:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772620.107088:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772620.363497:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772621.134264:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772622.165248:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790772622.529499:0:15007:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790772622.529503:0:15007:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790772622.529620:0:15007:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9328b9432800 00000020:01000004:0.0:1790772622.529636:0:15007:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790772622.529649:0:15007:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790772622.529663:0:15007:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9328bfbc0000) 00000020:00000080:0.0:1790772622.529680:0:15007:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790772622.558924:0:15007:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790772622.564302:0:15007:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790772622.566756:0:15007:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790772622.567803:0:15007:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790772622.568081:0:15007:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790772622.570371:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 503: rc = 0 00100000:10000000:2.0:1790772622.570559:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 503: rc = 0 00100000:10000000:2.0:1790772622.570664:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 503: rc = 0 00100000:10000000:2.0:1790772622.571517:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 243: rc = 0 00100000:10000000:2.0:1790772622.571749:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 243: rc = 0 00100000:10000000:2.0:1790772622.573574:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 243: rc = 0 00100000:10000000:2.0:1790772622.574187:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 243: rc = 0 00100000:10000000:2.0:1790772622.574540:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 243: rc = 0 00100000:10000000:2.0:1790772622.574811:0:15007:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 243: rc = 0 00000020:00000080:3.0:1790772622.575942:0:15007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790772622.575954:0:15007:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790772622.575966:0:15007:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd3c7635991be25f1 00000020:01000004:3.0:1790772622.575974:0:15007:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790772622.576321:0:15007:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790772622.576325:0:15007:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790772622.576333:0:15007:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790772622.576337:0:15007:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790772622.576350:0:15007:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9328b9bf3380) 00000020:00000080:3.0:1790772622.576360:0:15007:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790772622.579549:0:15007:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772622.579742:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790772622.579749:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790772622.591805:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790772622.591820:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790772622.592425:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790772622.592433:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790772622.593759:0:15007:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772622.595063:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790772622.595071:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790772622.597680:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790772622.597692:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790772622.640145:0:15007:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772622.640608:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790772622.640616:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790772622.642147:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790772622.642157:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790772622.643288:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790772622.643298:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790772622.646258:0:15007:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772622.646761:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790772622.646768:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790772622.652915:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790772622.652930:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790772622.724071:0:15007:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772622.724679:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790772622.724690:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790772622.726190:0:15007:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790772622.726202:0:15007:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790772622.727008:0:15007:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790772622.727033:0:15007:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790772622.727039:0:15007:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790772622.751738:0:15007:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790772622.751790:0:15007:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1790772622.751795:0:15007:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790772622.751797:0:15007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790772622.751798:0:15007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772622.751799:0:15007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772622.751801:0:15007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772622.751802:0:15007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772622.751804:0:15007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772622.751805:0:15007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772622.751807:0:15007:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790772622.751810:0:15007:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1790772622.751812:0:15007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772622.751813:0:15007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790772622.751815:0:15007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772622.751816:0:15007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772622.751817:0:15007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772622.751818:0:15007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772622.751818:0:15007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772622.751819:0:15007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772622.751820:0:15007:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790772622.751861:0:15007:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790772622.752124:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396096:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790772622.752211:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772622.752352:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff932882d026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772622.752700:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396096 00000100:00100000:3.0:1790772622.752709:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396096 00000100:00100000:3.0:1790772622.752799:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790772622.752808:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:15007:x1877760813396096:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790772622.752845:0:14317:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790772622.752848:0:14317:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1790772622.752852:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790772622.791734:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:15007:x1877760813396096:12345-0@lo:253:mount.lustre.0 Request processed in 38916us (39512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772622.791751:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790772622.792024:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396096:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790772622.792041:0:15007:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790772622.792045:0:15007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772622.792047:0:15007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790772622.792048:0:15007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772622.792049:0:15007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772622.792050:0:15007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772622.792052:0:15007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772622.792053:0:15007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772622.792055:0:15007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772622.792056:0:15007:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790772622.792076:0:15007:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9328b9432800 from lustre-OST0000 10000000:01000000:1.0:1790772622.792105:0:15007:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790772622.792120:0:15007:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790772622.792127:0:15007:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9328882f0000 local copy 00010000:00010000:1.0:1790772622.792138:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772622.792700:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772622.792744:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772622.792795:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff932882d02600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772622.793263:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396224 00000100:00100000:3.0:1790772622.793272:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396224 00000100:00100000:3.0:1790772622.793448:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772622.793459:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:15007:x1877760813396224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772622.793779:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+12:15007:x1877760813396224:12345-0@lo:501:mount.lustre.0 Request processed in 322us (1033us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772622.793786:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772622.793919:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396224:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790772622.793936:0:15007:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790772622.796711:0:15007:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790772622.796727:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.796740:0:15007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772622.796767:0:15007:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9328b9432800 10000000:01000000:3.0:1790772622.796773:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772622.796778:0:15007:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9328882f0000 10000000:01000000:3.0:1790772622.796780:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790772622.796783:0:15007:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9328882f0000 from 1 10000000:01000000:3.0:1790772622.796786:0:15007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790772622.796831:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.796841:0:15007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.796852:0:15007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772622.796895:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772622.796963:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.797151:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a17660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772622.800230:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396352 00000100:00100000:0.0:1790772622.800244:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396352 00000100:00100000:0.0:1790772622.800644:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772622.800657:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+12:15007:x1877760813396352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772622.800675:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772622.800696:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93289ed92c00/0xd3c7635991be2606 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be25ff expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.800722:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed92c00/0xd3c7635991be2606 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be25ff expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.800733:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93289ed92c00/0xd3c7635991be2606 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be25ff expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.800742:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92c00, rc 0) 00000100:00100000:0.0:1790772622.800829:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+13:15007:x1877760813396352:12345-0@lo:101:mount.lustre.0 Request processed in 175us (3865us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772622.800836:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772622.800933:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772622.800953:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2606 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772622.800979:0:15007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2606 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772622.801017:0:15007:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790772622.801038:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2606 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772622.801053:0:15007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9000/0xd3c7635991be25ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2606 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772622.801062:0:15007:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790772622.801068:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772622.801073:0:15007:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790772622.801075:0:15007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772622.801100:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772622.801120:0:15007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772622.801129:0:15007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772622.801148:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772622.801196:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772622.812182:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396480 00000100:00100000:0.0:1790772622.812199:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396480 00000100:00100000:0.0:1790772622.812268:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772622.812278:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+13:15007:x1877760813396480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772622.812631:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772622.812657:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93289ed93a00/0xd3c7635991be2614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be260d expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.812704:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed93a00/0xd3c7635991be2614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be260d expref: 14 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.812717:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93289ed93a00/0xd3c7635991be2614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be260d expref: 14 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.812725:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93a00, rc 0) 00000100:00100000:0.0:1790772622.812796:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396480:12345-0@lo:101:mount.lustre.0 Request processed in 520us (11600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772622.812803:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772622.820025:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff932882d02600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772622.820077:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772622.820106:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2614 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.820128:0:15007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2614 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772622.821658:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790772622.826805:0:15007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772622.827762:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790772622.827820:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790772622.827855:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790772622.827929:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790772622.831190:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790772622.831290:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790772622.831823:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790772622.831834:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790772622.831967:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772622.832711:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.832760:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772622.833089:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396608 00000100:00100000:0.0:1790772622.833097:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396608 00000100:00100000:0.0:1790772622.833166:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790772622.833176:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772622.833968:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396608:12345-0@lo:501:mount.lustre.0 Request processed in 792us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772622.833978:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772622.835146:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772622.835218:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772622.835276:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772622.835650:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396736 00000100:00100000:1.0:1790772622.835658:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396736 00000100:00100000:1.0:1790772622.835701:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790772622.835718:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772622.836758:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396736:12345-0@lo:503:mount.lustre.0 Request processed in 1039us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.836768:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772622.849337:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772622.849387:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772622.851257:0:15007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772622.851648:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772622.851732:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772622.851833:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772622.859189:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396864 00000100:00100000:3.0:1790772622.859206:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396864 00000100:00100000:3.0:1790772622.859277:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772622.859297:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772622.860279:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396864:12345-0@lo:502:mount.lustre.0 Request processed in 988us (8543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772622.860301:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790772622.861446:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772622.861762:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790772622.861826:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790772622.861860:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790772622.861965:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790772622.862017:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790772622.862055:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790772622.862118:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790772622.862173:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790772622.862208:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790772622.862259:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790772622.862297:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790772622.862343:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1790772622.862385:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772622.862454:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772622.862499:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772622.862954:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813396992 00000100:00100000:0.0:1790772622.862962:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813396992 00000100:00100000:0.0:1790772622.863016:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772622.863026:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772622.863253:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813396992:12345-0@lo:502:mount.lustre.0 Request processed in 228us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772622.863262:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790772622.863655:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813396992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772622.863735:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1790772622.863747:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1790772622.884606:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790772622.884619:0:15021:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790772622.884627:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772622.884630:0:15021:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790772622.884636:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772622.884656:0:15021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9328833f19c0) 00000020:00000080:1.0:1790772622.884679:0:15021:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790772622.884687:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790772622.884753:0:15021:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9328b9432800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790772622.884761:0:15021:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790772622.884768:0:15021:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd3c7635991be2622 00010000:00010000:1.0:1790772622.898817:0:15021:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1790772622.899270:0:15021:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1790772622.914482:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790772622.920631:0:15021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790772622.920643:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772622.920648:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772622.920651:0:15021:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790772622.920653:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790772622.920668:0:15021:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1790772622.920670:0:15021:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790772622.920672:0:15021:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790772622.920673:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790772622.920676:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772622.920677:0:15021:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790772622.920679:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772622.920682:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772622.920683:0:15021:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790772622.920685:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790772622.920687:0:15021:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790772622.920689:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772622.920691:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772622.920692:0:15021:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790772622.920694:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772622.920696:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772622.920698:0:15021:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790772622.920701:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790772622.920762:0:15021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772622.920764:0:15021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772622.920765:0:15021:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790772622.920768:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790772622.920944:0:15007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790772622.920972:0:15007:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790772622.920991:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2614 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921004:0:15007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328ba4da600/0xd3c7635991be260d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2614 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772622.921012:0:15007:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328b9432800 from 1 10000000:01000000:3.0:1790772622.921015:0:15007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772622.921047:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921054:0:15007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921066:0:15007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772622.921089:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772622.921167:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.921209:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397120 00000100:00100000:3.0:1790772622.921216:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397120 00000100:00100000:3.0:1790772622.921252:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772622.921261:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+14:15007:x1877760813397120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772622.921274:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772622.921285:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2629 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921313:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2629 expref: 15 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921323:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2629 expref: 15 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921332:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8200, rc 0) 00000100:00100000:3.0:1790772622.921367:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397120:12345-0@lo:101:mount.lustre.0 Request processed in 107us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772622.921374:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772622.921430:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772622.921453:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772622.921468:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.921477:0:15007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772622.921932:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790772622.922305:0:15007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772622.922525:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790772622.922569:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790772622.922642:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790772622.922650:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790772622.922702:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772622.922746:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.922767:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.924643:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397248 00000100:00100000:1.0:1790772622.924658:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397248 00000100:00100000:1.0:1790772622.924718:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790772622.924728:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772622.925019:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397248:12345-0@lo:501:mount.lustre.0 Request processed in 292us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.925027:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790772622.927184:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772622.927245:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772622.927318:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.927364:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790772622.927502:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397376 00000100:00100000:0.0:1790772622.927509:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397376 00000100:00100000:0.0:1790772622.927549:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790772622.927558:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772622.927756:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397376:12345-0@lo:503:mount.lustre.0 Request processed in 198us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772622.927763:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790772622.928437:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397376:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790772622.931467:0:15007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790772622.931556:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772622.931632:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.931675:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.931753:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397504 00000100:00100000:1.0:1790772622.931759:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397504 00000100:00100000:1.0:1790772622.931802:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790772622.931810:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772622.932007:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397504:12345-0@lo:502:mount.lustre.0 Request processed in 198us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.932016:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772622.932223:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772622.932478:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790772622.932529:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790772622.932578:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790772622.932614:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790772622.932645:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790772622.932690:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790772622.932726:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790772622.932759:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790772622.932784:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772622.932827:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772622.932870:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.933013:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397632 00000100:00100000:1.0:1790772622.933018:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397632 00000100:00100000:1.0:1790772622.933057:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790772622.933064:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772622.933210:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397632:12345-0@lo:502:mount.lustre.0 Request processed in 145us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.933218:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772622.933447:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772622.933534:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790772622.933543:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790772622.934435:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772622.934444:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772622.934446:0:15025:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790772622.934452:0:15025:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9328b9432800 00000020:00000080:0.0:1790772622.934454:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772622.934461:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772622.934464:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772622.934465:0:15025:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790772622.934467:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772622.934469:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772622.934470:0:15025:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790772622.934474:0:15025:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9328b9432800 00000020:00000080:0.0:1790772622.934476:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772622.934533:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772622.934537:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772622.934538:0:15025:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790772622.934548:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772622.934551:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772622.934552:0:15025:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790772622.934555:0:15025:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9328b9432800 00000020:00000080:0.0:1790772622.934557:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790772622.934593:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772622.934597:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772622.934598:0:15025:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790772622.934601:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790772622.935013:0:15007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790772622.935036:0:15007:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772622.935063:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772622.935075:0:15007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772622.935134:0:15007:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790772622.935137:0:15007:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9328b9432800 10000000:01000000:2.0:1790772622.935140:0:15007:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9328b9432800 10000000:01000000:2.0:1790772622.935145:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772622.935150:0:15007:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9328b9432800 from 1 10000000:01000000:2.0:1790772622.935153:0:15007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772622.935184:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772622.935191:0:15007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772622.935200:0:15007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772622.935222:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772622.935292:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772622.942788:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772622.952894:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397760 00000100:00100000:3.0:1790772622.952910:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397760 00000100:00100000:3.0:1790772622.952958:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790772622.952966:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813397760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772622.952982:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772622.952999:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be263e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2637 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.953025:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be263e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2637 expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.953037:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9200/0xd3c7635991be263e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2637 expref: 16 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772622.953045:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9200, rc 0) 00000100:00100000:3.0:1790772622.953127:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813397760:12345-0@lo:101:mount.lustre.0 Request processed in 162us (17835us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772622.953134:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790772622.955799:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772622.955827:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be263e expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772622.955839:0:15007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be263e expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772622.957032:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790772622.957352:0:15007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772622.957586:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790772622.957629:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790772622.957663:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790772622.957709:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790772622.957745:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790772622.957790:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790772622.957823:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790772622.957854:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790772622.957937:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790772622.957974:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790772622.958005:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790772622.958052:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790772622.958103:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790772622.967220:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790772622.967317:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790772622.967369:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790772622.967405:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790772622.967455:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790772622.967491:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790772622.967526:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790772622.967587:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790772622.967641:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790772622.967674:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790772622.967724:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790772622.967759:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790772622.967793:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790772622.967841:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790772622.967921:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790772622.968009:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790772622.968016:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1790772622.968137:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772622.968211:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.968260:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.968425:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813397888 00000100:00100000:1.0:1790772622.968433:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813397888 00000100:00100000:1.0:1790772622.968481:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772622.968491:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813397888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772622.968736:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813397888:12345-0@lo:501:mount.lustre.0 Request processed in 245us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.968745:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790772622.969723:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813397888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772622.969772:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772622.969825:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.970669:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1b22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.974039:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398016 00000100:00100000:1.0:1790772622.974054:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398016 00000100:00100000:1.0:1790772622.974130:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790772622.974140:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772622.974521:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398016:12345-0@lo:503:mount.lustre.0 Request processed in 381us (4695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.974530:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790772622.974658:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772622.975262:0:15007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772622.975340:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772622.975401:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772622.975439:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.975990:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398144 00000100:00100000:1.0:1790772622.975997:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398144 00000100:00100000:1.0:1790772622.976036:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790772622.976043:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772622.976740:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398144:12345-0@lo:502:mount.lustre.0 Request processed in 694us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.976749:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790772622.976912:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772622.977296:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790772622.977360:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790772622.977393:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790772622.977449:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790772622.977487:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790772622.977533:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790772622.977848:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790772622.977989:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790772622.978044:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790772622.978081:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790772622.978139:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790772622.978388:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790772622.978425:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790772622.978458:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790772622.978505:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790772622.978541:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790772622.978656:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790772622.978705:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790772622.978740:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790772622.978772:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790772622.978817:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790772622.978850:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790772622.979850:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790772622.980345:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790772622.980384:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790772622.980417:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790772622.980484:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790772622.980519:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790772622.980629:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790772622.980681:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790772622.980714:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790772622.980743:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790772622.980772:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790772622.980814:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790772622.980856:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790772622.981233:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790772622.981275:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790772622.981307:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790772622.981353:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790772622.981388:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790772622.981437:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772622.981522:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772622.981668:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772622.981711:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398272 00000100:00100000:1.0:1790772622.981719:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398272 00000100:00100000:1.0:1790772622.981799:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790772622.981809:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772622.982077:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398272:12345-0@lo:502:mount.lustre.0 Request processed in 269us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772622.982086:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772622.982318:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772622.982391:0:15007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790772622.982401:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790772622.983997:0:15030:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790772622.984013:0:15030:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9328b9bf0000) 00000020:00000080:3.0:1790772622.984043:0:15030:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790772622.984428:0:15030:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9328b9432800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790772622.984433:0:15030:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9328b9432800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790772622.984436:0:15030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9328b9432800 3 00010000:00080000:3.0:1790772622.984465:0:15030:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932891906000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1790772622.989837:0:15030:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1790772622.990334:0:15030:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790772622.990373:0:15030:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790772622.990392:0:15030:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd3c7635991be264c 00000100:00080000:3.0:1790772622.990402:0:15030:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772622.990414:0:15030:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff932891906000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1790772622.990452:0:15030:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93289ee88a80 x1877760813398400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772622.990482:0:15030:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790772622.990566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1877760813398400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790772622.990637:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772622.990981:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398400 00000100:00100000:3.0:1790772622.990990:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398400 00000100:00100000:3.0:1790772622.991022:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772622.991029:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1877760813398400:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790772622.991052:0:14325:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1790772622.991102:0:14325:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd3c7635991be2653 00000004:00100000:3.0:1790772622.991130:0:14325:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790772622.991166:0:14325:0:(import.c:65:import_set_state_nolock()) ffff932890710800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772622.991223:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877760813398400:12345-0@lo:38:llog_process_th.0 Request processed in 193us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772622.991231:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790772622.991387:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93289ee88a80 x1877760813398400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772622.991397:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772622.991404:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790772622.991411:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790772622.991414:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790772622.991417:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932891906000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790772622.991423:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1877760813398400:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1790772622.991490:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772622.991495:0:12655:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772622.991498:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772622.991501:0:12655:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790772622.991663:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772622.991673:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813398528:0@lo:400:kworker.0 00000100:00100000:0.0:1790772622.991707:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790772622.992434:0:15030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1790772622.992559:0:15007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790772622.992589:0:15007:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772622.992611:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be263e expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772622.992621:0:15007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328b974d200/0xd3c7635991be2637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be263e expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790772622.992674:0:15007:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790772622.992676:0:15007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790772622.992677:0:15007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772622.992678:0:15007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772622.992679:0:15007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772622.992681:0:15007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772622.992682:0:15007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772622.992684:0:15007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772622.992685:0:15007:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772622.992689:0:15007:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790772622.992691:0:15007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772622.992692:0:15007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790772622.992693:0:15007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772622.992694:0:15007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772622.992695:0:15007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772622.992696:0:15007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772622.992697:0:15007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772622.992698:0:15007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772622.992699:0:15007:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772622.992716:0:15007:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790772622.992728:0:15007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398656:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790772622.992768:0:15007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772622.992801:0:15007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b971c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772622.993002:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398656 00000100:00100000:0.0:1790772622.993009:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398656 00000100:00100000:0.0:1790772622.993048:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790772622.993057:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15007:x1877760813398656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790772622.993095:0:14319:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790772622.993122:0:14319:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790772622.993900:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398528 00000100:00100000:2.0:1790772622.993908:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398528 00000100:00100000:2.0:1790772622.993944:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772622.993952:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813398528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772622.994021:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813398528:12345-0@lo:400:kworker.0 Request processed in 69us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772622.994028:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790772622.994073:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9328bf51dc00 x1877760813398528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772622.994087:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813398528:0@lo:400:kworker.0 20000000:01000000:1.0:1790772623.030655:0:14319:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790772623.030709:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790772623.036640:0:14341:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790772623.036653:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790772623.036679:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772623.036716:0:14341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 16 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772623.036725:0:14341:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772623.036770:0:14341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 16 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772623.036786:0:14341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 16 pid: 14317 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772623.036800:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14341:1877760813398784:0@lo:104: 00000100:00100000:0.0:1790772623.036864:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772623.036930:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328830e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772623.036965:0:14309:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398784 00000100:00100000:0.0:1790772623.036973:0:14309:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398784 00000100:00100000:0.0:1790772623.037016:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772623.037025:0:14309:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14341:x1877760813398784:12345-0@lo:104: 00010000:00010000:0.0:1790772623.037037:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772623.037088:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772623.037094:0:14309:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14341:x1877760813398784:12345-0@lo:104: Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772623.037101:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772623.037160:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14341:1877760813398784:0@lo:104: 00010000:00010000:0.0:1790772623.037178:0:14341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.037892:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772623.037900:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.037909:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c200 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:1.0:1790772623.037913:0:14314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.037921:0:14314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772623.037928:0:14314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772623.037934:0:14314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772623.037986:0:14314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.037993:0:14314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772623.038028:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038035:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328b974c200/0xd3c7635991be25c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be25c7 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038052:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772623.038055:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772623.038056:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772623.038174:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813398912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772623.038218:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772623.038780:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813398912 00000100:00100000:1.0:1790772623.038787:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813398912 00010000:00010000:1.0:1790772623.038813:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 17 pid: 14317 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772623.038851:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772623.038859:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+17:3316:x1877760813398912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772623.038908:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772623.038914:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 17 pid: 14317 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038924:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 17 pid: 14317 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038938:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932880030600/0xd3c7635991be25c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be25c0 expref: 17 pid: 14317 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038953:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038970:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790772623.038985:0:14312:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006467262s 00010000:00010000:1.0:1790772623.038990:0:14312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.038996:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039003:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039010:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039015:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772623.039020:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039027:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039043:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039053:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772623.039097:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3316:x1877760813398912:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772623.039116:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772623.039283:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813398912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772623.039310:0:14341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039317:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772623.039324:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93289ed92400/0xd3c7635991be265a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772623.043238:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+15:15007:x1877760813398656:12345-0@lo:253:mount.lustre.0 Request processed in 50173us (50460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772623.043253:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790772623.043340:0:15007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15007:1877760813398656:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790772623.043356:0:15007:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790772623.043360:0:15007:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790772623.043362:0:15007:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790772623.043364:0:15007:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772623.043365:0:15007:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772623.043366:0:15007:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772623.043367:0:15007:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772623.043369:0:15007:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772623.043371:0:15007:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772623.043373:0:15007:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790772623.043388:0:15007:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790772623.048701:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790772623.048861:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790772623.049371:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790772623.049517:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790772623.049736:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790772623.050535:0:15007:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790772623.051500:0:15007:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790772623.104812:0:15007:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790772623.104823:0:15007:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790772623.104859:0:15007:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772623.105225:0:15007:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772623.105246:0:15007:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790772623.105276:0:15007:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790772623.182053:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772624.205486:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790772624.780979:0:14322:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790772624.780986:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93288694b000 from 7 10000000:01000000:3.0:1790772624.780998:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772624.781041:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772624.781053:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772624.781064:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772624.781101:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813399040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772624.781168:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772624.781223:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886db2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772624.782241:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399040 00000100:00100000:2.0:1790772624.782250:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399040 00000100:00100000:2.0:1790772624.782312:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790772624.782323:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+15:14322:x1877760813399040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772624.782339:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772624.782356:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2661 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772624.782380:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2661 expref: 16 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772624.782391:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2661 expref: 16 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772624.782400:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d600, rc 0) 00000100:00100000:2.0:1790772624.782468:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:14322:x1877760813399040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772624.782475:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790772624.782532:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813399040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772624.782549:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772624.782559:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772624.782619:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813399168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790772624.782653:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772624.782679:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328830e1240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772624.786784:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399168 00000100:00100000:1.0:1790772624.786800:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399168 00000100:00100000:1.0:1790772624.786864:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790772624.786896:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:14322:x1877760813399168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790772624.786925:0:14319:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772624.786943:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772624.786946:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790772624.787124:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:14322:x1877760813399168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 251us (4470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772624.787133:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790772624.787736:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813399168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790772624.787808:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790772624.787819:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772624.787830:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772625.228771:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772626.252010:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772627.288691:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772628.174084:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772628.174092:0:12655:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772628.174095:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772628.174098:0:12655:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790772628.174150:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d178e578-a8f2-4768-8767-0ddb2fe17697:3317:1877760813399296:0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.174216:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772628.174262:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772628.174268:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813399424:0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.174294:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772628.177516:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772628.177539:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813399552:0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.177597:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772628.177634:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399296 00000100:00100000:2.0:1790772628.177640:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399296 00000100:00100000:2.0:1790772628.177673:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790772628.177678:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3317:x1877760813399296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.177719:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3317:x1877760813399296:12345-0@lo:400:kworker.0 Request processed in 40us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772628.177723:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790772628.177748:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399424 00000100:00100000:2.0:1790772628.177750:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399424 00000100:00100000:2.0:1790772628.177767:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399552 00000100:00100000:2.0:1790772628.177769:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399552 00000100:00100000:2.0:1790772628.177793:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772628.177799:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813399424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.177841:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813399424:12345-0@lo:400:kworker.0 Request processed in 41us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772628.177847:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772628.177859:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772628.177864:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813399552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.180402:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813399552:12345-0@lo:400:kworker.0 Request processed in 2528us (2794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772628.180415:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790772628.180567:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790772628.180607:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf51c380 x1877760813399552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772628.180622:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813399552:0@lo:400:kworker.0 00010000:00080000:2.0:1790772628.180818:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf51ce00 x1877760813399424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772628.180827:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813399424:0@lo:400:kworker.0 00000100:00100000:2.0:1790772628.180838:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d178e578-a8f2-4768-8767-0ddb2fe17697:3317:1877760813399296:0@lo:400:kworker.0 00010000:00010000:1.0:1790772628.299789:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772629.324691:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772630.153043:0:15375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790772630.350002:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772630.603493:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790772631.376815:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772632.395071:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772633.227103:0:3314:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772618/real 1790772618] req@ffff9328bf629500 x1877760813395712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772633 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772633.227135:0:3314:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9328bf629500 x1877760813395712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772633 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772633.227145:0:3314:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772618/real 1790772618] req@ffff9328bf629880 x1877760813395840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772633 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772633.227168:0:3314:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9328bf629880 x1877760813395840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772633 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772633.227188:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9328b8d5a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772633.227215:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772633.227219:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813395712:0@lo:8:kworker.0 00000100:00080000:3.0:1790772633.227225:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772633.227231:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790772633.227233:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813395840:0@lo:8:kworker.0 00000100:00080000:1.0:1790772633.227340:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772633.227344:0:12655:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790772633.227347:0:12655:0:(import.c:65:import_set_state_nolock()) ffff9328b8d5a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772633.227352:0:12655:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1790772633.227357:0:12655:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790772633.227366:0:12655:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9328b8d5a000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772633.227385:0:12655:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf62ad80 x1877760813399808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772633.227401:0:12655:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772633.227404:0:12655:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790772633.227406:0:12655:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772633.227409:0:12655:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1790772633.227411:0:12655:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790772633.227416:0:12655:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932894ae3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1790772633.227426:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813399808:0@lo:8:kworker.0 00000100:00100000:1.0:1790772633.227487:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772633.227546:0:12655:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf62a680 x1877760813399936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772633.227565:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813399936:0@lo:8:kworker.0 00000100:00100000:1.0:1790772633.227590:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772633.227675:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399808 00000100:00100000:1.0:1790772633.227683:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399808 00000100:00100000:1.0:1790772633.227706:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399936 00000100:00100000:1.0:1790772633.227709:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399936 00000100:00100000:1.0:1790772633.227722:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772633.227728:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1877760813399808:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790772633.227753:0:15010:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:1.0:1790772633.227785:0:15010:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be266f 00002000:00100000:1.0:1790772633.227798:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9328a0230800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790772633.227802:0:15010:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790772633.227805:0:15010:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790772633.228153:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790772633.228174:0:15010:0:(import.c:65:import_set_state_nolock()) ffff9328a0232800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772633.228219:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1877760813399808:12345-0@lo:8:kworker.0 Request processed in 489us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772633.228225:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772633.228242:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772633.228245:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1877760813399936:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790772633.228255:0:15010:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790772633.228276:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1877760813399936:12345-0@lo:8:kworker.0 Request processed in 29us (685us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790772633.228281:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790772633.228314:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772633.228318:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790772633.228321:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813399936:0@lo:8:kworker.0 00010000:00080000:1.0:1790772633.228332:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf62ad80 x1877760813399808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772633.228345:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772633.228351:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790772633.228357:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790772633.228361:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790772633.228363:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9328b8d5a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790772633.228375:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790772633.228379:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813399808:0@lo:8:kworker.0 00000004:00080000:1.0:1790772633.228410:0:14348:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790772633.228425:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14348:1877760813400448:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790772633.228449:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772633.228464:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff932891864f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772633.228474:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400448 00000100:00100000:1.0:1790772633.228477:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400448 00000100:00100000:1.0:1790772633.228508:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772633.228514:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14348:x1877760813400448:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790772633.230920:0:15010:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00000100:00100000:3.0:1790772633.231013:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813399680:0@lo:400:kworker.0 00000100:00100000:3.0:1790772633.231083:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772633.231139:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772633.231145:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813400320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772633.231172:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772633.231209:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813399680 00000100:00100000:3.0:1790772633.231218:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813399680 00000100:00100000:3.0:1790772633.231255:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790772633.231262:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3316:x1877760813399680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772633.231314:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3316:x1877760813399680:12345-0@lo:400:kworker.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772633.231320:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790772633.231365:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813399680:0@lo:400:kworker.0 00000100:00100000:2.0:1790772633.231508:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813400064:0@lo:400:kworker.0 00000100:00100000:2.0:1790772633.231541:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772633.231574:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772633.231581:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813400192:0@lo:400:kworker.0 00000100:00100000:2.0:1790772633.231604:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790772633.231636:0:14347:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790772633.232004:0:14347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 454052128338ns, next at 0ns, rc = 0 00000100:00080000:2.0:1790772633.232031:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772633.232055:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400320 00000100:00100000:2.0:1790772633.232059:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400320 00000100:00100000:2.0:1790772633.232085:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772633.232092:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813400320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772633.232118:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772633.232156:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813400320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772633.232162:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772633.232185:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400064 00000100:00100000:2.0:1790772633.232188:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400064 00000100:00100000:2.0:1790772633.232209:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400192 00000100:00100000:2.0:1790772633.232211:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400192 00000100:00100000:2.0:1790772633.232231:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772633.232237:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813400064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772633.232274:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813400064:12345-0@lo:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772633.232279:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772633.232290:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772633.232296:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813400192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772633.232322:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813400192:12345-0@lo:400:kworker.0 Request processed in 26us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772633.232327:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790772633.232342:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790772633.232363:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf62b100 x1877760813400192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772633.232373:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813400192:0@lo:400:kworker.0 00010000:00080000:2.0:1790772633.232392:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf629500 x1877760813400064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772633.232399:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813400064:0@lo:400:kworker.0 00010000:00080000:3.0:1790772633.233067:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf62ad80 x1877760813400320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772633.233096:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813400320:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1790772633.243769:0:15010:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790772633.243779:0:15010:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1790772633.261241:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.261252:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261267:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.261271:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.261277:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261305:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261316:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261324:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261341:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.261352:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.261357:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261364:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dba00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.261368:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261377:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261391:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261398:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2676 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261419:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.261421:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.261422:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.261806:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.261811:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261820:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.261823:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.261827:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261836:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261844:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261852:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261865:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.261890:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.261894:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261911:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dbe00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.261915:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261923:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261947:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261954:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be267d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.261966:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.261968:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.261969:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.262304:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.262310:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262319:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.262322:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.262326:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262335:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262348:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262355:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262368:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.262374:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.262377:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262384:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dbc00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.262387:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262395:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262404:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262411:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be2684 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262423:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.262428:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.262430:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.262745:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.262750:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262759:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.262762:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.262766:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262774:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262782:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262789:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262801:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.262807:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.262811:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262817:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4daa00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.262820:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262838:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262848:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262855:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be268b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.262866:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.262868:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.262869:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.271948:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.271961:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275606:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.275619:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.275629:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275650:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275661:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275687:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275708:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.275726:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.275732:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275739:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.275744:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275754:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275769:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275776:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.275796:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.275798:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.275800:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.276452:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.276467:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276477:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.276480:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.276485:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276496:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276503:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276510:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276525:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.276535:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.276539:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276547:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.276550:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276558:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276578:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276584:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be2699 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.276598:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.276600:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.276601:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.282209:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.282224:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282242:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.282247:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.282254:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282268:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282278:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282286:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282316:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.282329:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.282334:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282341:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.282346:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282355:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282371:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282379:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.282398:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.282400:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.282402:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.289113:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.289128:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289145:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.289159:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.289166:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289181:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289191:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289199:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289220:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.289238:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.289243:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289250:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.289255:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289262:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289277:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289295:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.289313:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.289315:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.289316:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.293337:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.293350:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293368:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.293372:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.293380:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293394:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293405:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293413:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293440:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.293450:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.293461:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293468:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.293473:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293482:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293497:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293504:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.293523:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.293525:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.293527:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.311744:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.311756:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311775:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.311779:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.311786:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311814:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311826:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311835:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311855:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.311867:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.311904:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311912:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.311917:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311938:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311955:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311963:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.311987:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.311989:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.311991:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.312424:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.312431:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312440:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.312443:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.312447:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312455:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312464:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312471:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312487:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.312496:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.312500:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312517:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.312519:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312526:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312537:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312543:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.312555:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.312557:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.312558:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.312988:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.312995:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313003:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.313006:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.313010:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313018:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313032:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313040:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313055:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.313063:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.313067:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313073:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.313076:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313083:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313093:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313099:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.313111:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.313119:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.313121:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.330505:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.330519:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.330537:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.330541:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.330547:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.330561:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.330571:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.330579:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.330601:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772633.330906:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772633.330914:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.330922:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772633.330937:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.330946:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.330966:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.330973:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a326e953/0xd3c7635991be26ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.330991:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772633.330993:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772633.330994:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.331090:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.331095:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331104:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.331107:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.331111:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331127:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331135:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331141:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331155:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.331164:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.331167:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331174:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.331176:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331183:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331192:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331198:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5ef88a8/0xd3c7635991be26d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331215:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.331216:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.331218:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.331589:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.331595:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331603:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.331606:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.331610:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331619:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331627:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331635:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.331650:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790772633.332080:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.332086:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332105:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.332108:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.332113:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332123:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332131:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332137:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332151:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790772633.332161:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772633.332166:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332172:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4daa00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.332175:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332183:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332204:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.332207:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.332211:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be26d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332226:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.332228:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.332229:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.332599:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.332605:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332615:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.332618:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.332622:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332633:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332642:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332650:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.332681:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772633.334146:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772633.334158:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.334186:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dbe00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:3.0:1790772633.334190:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.334200:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.334219:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.334227:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009034e33f/0xd3c7635991be26e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772633.334249:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772633.334251:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772633.334253:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.344521:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.344536:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.344549:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dbc00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772633.344554:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.344567:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.344627:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.344636:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8931b5c/0xd3c7635991be26df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.344658:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.344660:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.344662:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.344667:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.344668:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.358738:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.358754:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358773:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.358779:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.358786:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358801:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358811:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358818:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358839:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.358855:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.358860:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358867:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.358907:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358918:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358948:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358955:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be26ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.358974:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.358976:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.358978:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.362316:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.362328:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.362345:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.362349:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.362356:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.362369:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.362378:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.362395:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.362422:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790772633.366199:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.366212:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.366231:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.366235:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.366242:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.366256:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.366267:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.366276:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.366303:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790772633.371598:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.373784:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373816:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.373821:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.373828:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373843:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373854:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373863:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373909:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772633.373915:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373922:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.373937:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373947:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373976:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.373984:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be26f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374006:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.374010:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374017:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dba00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.374021:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374028:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374038:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374046:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be26fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374056:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.374058:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.374064:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.374077:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.374103:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.374107:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374115:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.374118:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374126:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374136:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374144:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be2702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.374157:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.374158:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.374160:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.379091:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.379106:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.379117:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.379122:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.379126:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.379137:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.379151:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.379160:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.379167:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.379181:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.380071:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.380091:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380101:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.380106:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380115:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380132:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380152:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7fc067/0xd3c7635991be2709 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380171:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.380173:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.380175:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.380453:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.380460:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380470:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.380474:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.380481:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380491:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380599:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380609:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380686:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.380699:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.380711:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380718:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.380723:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380731:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380746:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380754:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e863935/0xd3c7635991be2710 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.380769:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.380775:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.380777:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790772633.381151:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1790772633.385970:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.385983:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.386000:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.386005:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.386012:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.386038:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.386048:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.386057:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.386081:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772633.386381:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772633.386390:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.386400:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4da400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772633.386407:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.386416:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.386437:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772633.386447:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.386449:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.386450:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.390001:0:15010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0927f1/0xd3c7635991be2717 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772633.390522:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.390530:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.390544:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.390548:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.390555:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.390567:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.390590:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.390597:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.390615:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772633.390957:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772633.390968:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.390978:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772633.390983:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.390993:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772633.391055:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.391060:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391069:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.391072:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.391075:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391084:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391092:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391099:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391122:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.391131:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.391135:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391142:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dba00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.391145:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391153:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391163:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391170:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000703565a4/0xd3c7635991be2725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391184:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.391186:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.391187:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.391542:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.391548:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391556:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391557:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.391570:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772633.391573:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef8aaff2/0xd3c7635991be271e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391576:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391594:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391603:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391608:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.391612:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.391628:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772633.391680:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772633.391685:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391693:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772633.391751:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391761:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391775:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391783:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baea9f60/0xd3c7635991be272c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772633.391798:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772633.391808:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772633.391811:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772633.394524:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790772633.400850:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772633.400864:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.400897:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1790772633.400901:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772633.400907:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.400920:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.400941:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.400959:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.400977:0:15010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772633.400990:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772633.400996:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.401003:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4daa00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772633.401009:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.401020:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.401036:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.401044:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae11e171/0xd3c7635991be2733 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772633.401065:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.401067:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772633.401069:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1790772633.404359:0:15010:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1790772633.404469:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14348:x1877760813400448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 175950us (176014us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772633.404487:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772633.404544:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14348:1877760813400448:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790772633.404559:0:14348:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790772633.404602:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14348:1877760813400576:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790772633.404640:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772633.404680:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff932888e04900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772633.404699:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400576 00000100:00100000:1.0:1790772633.404705:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400576 00000100:00100000:1.0:1790772633.404736:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772633.404743:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14348:x1877760813400576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790772633.404779:0:15008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1790772633.419183:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772633.435986:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14348:x1877760813400576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 31236us (31339us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790772633.435999:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772633.440352:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14348:1877760813400576:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790772633.440373:0:14348:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:3.0:1790772633.442757:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790772634.443540:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772635.471354:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772636.492005:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772637.517392:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772638.412633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772638.412640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790772638.412644:0:37:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772638.412652:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:2.0:1790772638.412658:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790772638.412670:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932894ae3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1790772638.412694:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf51f480 x1877760813400960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772638.412759:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813400704:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.412825:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.412926:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772638.412933:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813401216:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.412963:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.412994:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813400832:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.413022:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.413045:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772638.413050:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813401088:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.413073:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.413113:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813400960:0@lo:8:kworker.0 00000100:00100000:2.0:1790772638.413139:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.413497:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400704 00000100:00100000:2.0:1790772638.413506:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400704 00000100:00100000:2.0:1790772638.413555:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772638.413565:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3316:x1877760813400704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.413619:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3316:x1877760813400704:12345-0@lo:400:kworker.0 Request processed in 56us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.413627:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772638.413660:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401216 00000100:00100000:2.0:1790772638.413664:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401216 00000100:00100000:2.0:1790772638.413698:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401088 00000100:00100000:2.0:1790772638.413701:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401088 00000100:00100000:2.0:1790772638.413717:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772638.413723:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813401216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.413768:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813401216:12345-0@lo:400:kworker.0 Request processed in 45us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.413775:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772638.413788:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772638.413794:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813401088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.413828:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813401088:12345-0@lo:400:kworker.0 Request processed in 34us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.413834:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772638.413871:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400832 00000100:00100000:2.0:1790772638.414049:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400832 00000100:00100000:2.0:1790772638.414076:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813400960 00000100:00100000:2.0:1790772638.414079:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813400960 00000100:00100000:1.0:1790772638.414212:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772638.414223:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813400832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772638.414262:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813400832:12345-0@lo:400:kworker.0 Request processed in 42us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772638.414268:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772638.414281:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772638.414286:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1877760813400960:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790772638.414304:0:15008:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1790772638.415237:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772638.415245:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790772638.415308:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf51dc00 x1877760813401088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772638.415325:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813401088:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.415341:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813400832:0@lo:400:kworker.0 00010000:00080000:2.0:1790772638.415379:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf51c000 x1877760813401216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772638.415389:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813401216:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.415400:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813400704:0@lo:400:kworker.0 00000100:00100000:2.0:1790772638.416573:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772638.416592:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813401344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772638.416649:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.416700:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401344 00000100:00100000:2.0:1790772638.416707:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401344 00000100:00100000:2.0:1790772638.416749:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772638.416758:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813401344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772638.416797:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772638.416852:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1877760813401344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.416859:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772638.418799:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813401344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772638.458393:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1877760813400960:12345-0@lo:8:kworker.0 Request processed in 44099us (45246us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790772638.458408:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790772638.458598:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772638.458604:0:3314:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790772638.458608:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813400960:0@lo:8:kworker.0 00000001:00080000:0.0:1790772638.520678:0:6730:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1790772638.545136:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790772638.612011:0:15731:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790772638.612016:0:15731:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790772638.612152:0:15731:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff932891907000 00000020:01000004:3.0:1790772638.612167:0:15731:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790772638.612181:0:15731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790772638.612194:0:15731:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9328b9bf19c0) 00000020:00000080:3.0:1790772638.612211:0:15731:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790772638.627219:0:15731:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790772638.627511:0:15731:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790772638.629985:0:15731:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790772638.630234:0:15731:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790772638.630446:0:15731:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790772638.630844:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 209: rc = 0 00100000:10000000:3.0:1790772638.631770:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 209: rc = 0 00100000:10000000:3.0:1790772638.632077:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 209: rc = 0 00100000:10000000:3.0:1790772638.632598:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 246: rc = 0 00100000:10000000:3.0:1790772638.632868:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 246: rc = 0 00100000:10000000:3.0:1790772638.633234:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 246: rc = 0 00100000:10000000:3.0:1790772638.633486:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 246: rc = 0 00100000:10000000:3.0:1790772638.633744:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 246: rc = 0 00100000:10000000:3.0:1790772638.634185:0:15731:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 246: rc = 0 00000020:00000080:3.0:1790772638.634773:0:15731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790772638.634787:0:15731:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790772638.634797:0:15731:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd3c7635991be2741 00000020:01000004:3.0:1790772638.634806:0:15731:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790772638.634827:0:15731:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790772638.634831:0:15731:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790772638.634849:0:15731:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790772638.634872:0:15731:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790772638.634978:0:15731:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790772638.647153:0:15731:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790772638.647196:0:15731:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790772638.647201:0:15731:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790772638.647202:0:15731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790772638.647204:0:15731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772638.647205:0:15731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772638.647206:0:15731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772638.647207:0:15731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772638.647213:0:15731:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772638.647215:0:15731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772638.647216:0:15731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772638.647220:0:15731:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790772638.647222:0:15731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772638.647224:0:15731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790772638.647224:0:15731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772638.647225:0:15731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772638.647226:0:15731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772638.647227:0:15731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772638.647228:0:15731:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772638.647229:0:15731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772638.647230:0:15731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772638.647258:0:15731:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790772638.647279:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772638.647351:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.647455:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a1653600 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.647603:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401472 00000100:00100000:2.0:1790772638.647611:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401472 00000100:00100000:2.0:1790772638.647713:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790772638.647723:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15731:x1877760813401472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790772638.647770:0:14317:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790772638.647774:0:14317:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790772638.647778:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790772638.662101:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15731:x1877760813401472:12345-0@lo:253:mount.lustre.0 Request processed in 14369us (14739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772638.662118:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790772638.662236:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790772638.662252:0:15731:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790772638.662255:0:15731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772638.662257:0:15731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790772638.662259:0:15731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772638.662260:0:15731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772638.662262:0:15731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772638.662263:0:15731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772638.662265:0:15731:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772638.662268:0:15731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772638.662269:0:15731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772638.662289:0:15731:0:(tgt_mount.c:101:server_register_mount()) register mount ffff932891907000 from lustre-OST0001 10000000:01000000:3.0:1790772638.662317:0:15731:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790772638.662320:0:15731:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790772638.662328:0:15731:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9328882f0000 local copy 00010000:00010000:3.0:1790772638.662340:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772638.662978:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772638.663026:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.663103:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328911fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.664528:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401600 00000100:00100000:0.0:1790772638.664540:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401600 00000100:00100000:0.0:1790772638.664802:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790772638.664813:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15731:x1877760813401600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772638.665175:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15731:x1877760813401600:12345-0@lo:501:mount.lustre.0 Request processed in 363us (2147us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772638.665184:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772638.665288:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401600:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790772638.665312:0:15731:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790772638.665490:0:15731:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790772638.665500:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.665511:0:15731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff932880030800/0xd3c7635991be24e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be24ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772638.665546:0:15731:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff932891907000 10000000:01000000:3.0:1790772638.665551:0:15731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772638.665557:0:15731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790772638.665559:0:15731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772638.665564:0:15731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790772638.665566:0:15731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790772638.665595:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.665602:0:15731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.665610:0:15731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772638.665629:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772638.665661:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.666077:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328911fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.666235:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401728 00000100:00100000:2.0:1790772638.666242:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401728 00000100:00100000:2.0:1790772638.666273:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772638.666281:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:15731:x1877760813401728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772638.666290:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772638.666305:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974cc00/0xd3c7635991be274f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2748 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.666327:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974cc00/0xd3c7635991be274f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2748 expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.666338:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974cc00/0xd3c7635991be274f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2748 expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.666353:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974cc00, rc 0) 00000100:00100000:2.0:1790772638.666397:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813401728:12345-0@lo:101:mount.lustre.0 Request processed in 117us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.666403:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790772638.666544:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772638.666561:0:15731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be274f expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.666570:0:15731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be274f expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772638.667183:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790772638.667821:0:15731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772638.668103:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790772638.668151:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790772638.668188:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790772638.668257:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790772638.668294:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790772638.668328:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790772638.668392:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790772638.668400:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790772638.668481:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772638.668534:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.668568:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328911ff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.669393:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401856 00000100:00100000:2.0:1790772638.669405:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401856 00000100:00100000:2.0:1790772638.669464:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790772638.669476:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813401856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772638.670361:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813401856:12345-0@lo:501:mount.lustre.0 Request processed in 884us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.670371:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790772638.673995:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772638.674068:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772638.674154:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.674293:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328911ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.674549:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813401984 00000100:00100000:0.0:1790772638.674557:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813401984 00000100:00100000:0.0:1790772638.674643:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772638.674653:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813401984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772638.675038:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813401984:12345-0@lo:503:mount.lustre.0 Request processed in 386us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.675044:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790772638.675177:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813401984:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790772638.676169:0:15731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790772638.676252:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772638.676315:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.676749:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328911ff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.676825:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402112 00000100:00100000:2.0:1790772638.676844:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402112 00000100:00100000:2.0:1790772638.676906:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790772638.676915:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813402112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772638.677169:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813402112:12345-0@lo:502:mount.lustre.0 Request processed in 253us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.677176:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790772638.677490:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772638.677723:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790772638.677780:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790772638.677817:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790772638.678052:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790772638.678095:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790772638.678130:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790772638.678209:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790772638.678254:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790772638.678307:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1790772638.678344:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772638.678394:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.678422:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328911ff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.678532:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402240 00000100:00100000:2.0:1790772638.678539:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402240 00000100:00100000:2.0:1790772638.678570:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790772638.678578:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813402240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772638.678744:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813402240:12345-0@lo:502:mount.lustre.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.678752:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790772638.678860:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772638.679032:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790772638.679043:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790772638.680417:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790772638.680427:0:15732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790772638.680506:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772638.680509:0:15732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790772638.680515:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772638.680530:0:15732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9328882f4d40) 00000020:00000080:2.0:1790772638.680553:0:15732:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790772638.680559:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790772638.680622:0:15732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff932891907000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790772638.680630:0:15732:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772638.680637:0:15732:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd3c7635991be275d 00010000:00010000:2.0:1790772638.684737:0:15732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1790772638.685369:0:15732:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1790772638.687572:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1790772638.689234:0:15732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790772638.689245:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772638.689252:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772638.689254:0:15732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790772638.689258:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772638.689262:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772638.689264:0:15732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790772638.689277:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790772638.689279:0:15732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790772638.689282:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772638.689284:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772638.689285:0:15732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790772638.689288:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772638.689290:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772638.689292:0:15732:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790772638.689295:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790772638.689351:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772638.689355:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772638.689357:0:15732:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790772638.689361:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1790772638.689534:0:15731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790772638.689574:0:15731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790772638.689600:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be274f expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.689613:0:15731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328bf5e8a00/0xd3c7635991be2748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be274f expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772638.689621:0:15731:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891907000 from 1 10000000:01000000:1.0:1790772638.689624:0:15731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772638.689673:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.689682:0:15731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.689693:0:15731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772638.689731:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772638.689800:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772638.689851:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff932882d02a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.690375:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402368 00000100:00100000:2.0:1790772638.690385:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402368 00000100:00100000:2.0:1790772638.690428:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790772638.690451:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:15731:x1877760813402368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772638.690467:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772638.690483:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2764 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.690507:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2764 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.690518:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2764 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.690527:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d800, rc 0) 00000100:00100000:2.0:1790772638.690573:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402368:12345-0@lo:101:mount.lustre.0 Request processed in 124us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.690580:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772638.690824:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772638.690852:0:15731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.690861:0:15731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772638.691426:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790772638.692014:0:15731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772638.692248:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790772638.692296:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790772638.692384:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790772638.692393:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790772638.692462:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772638.692519:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772638.692563:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff932882d02a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772638.692597:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402496 00000100:00100000:1.0:1790772638.692603:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402496 00000100:00100000:1.0:1790772638.692645:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772638.692654:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772638.692860:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402496:12345-0@lo:501:mount.lustre.0 Request processed in 206us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772638.692868:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772638.692957:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772638.692987:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772638.693026:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772638.693040:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ae568900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772638.693053:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402624 00000100:00100000:1.0:1790772638.693057:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402624 00000100:00100000:1.0:1790772638.693073:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790772638.693078:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772638.693283:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402624:12345-0@lo:503:mount.lustre.0 Request processed in 204us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772638.693291:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790772638.693331:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790772638.693730:0:15731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772638.693778:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772638.693813:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772638.694452:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402752 00000100:00100000:0.0:1790772638.694460:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402752 00000100:00100000:0.0:1790772638.694490:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790772638.694499:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772638.694693:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402752:12345-0@lo:502:mount.lustre.0 Request processed in 195us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.694701:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790772638.697544:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ae568900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772638.697589:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772638.698190:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790772638.698263:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790772638.698314:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790772638.698355:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790772638.698392:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790772638.698456:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790772638.698495:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790772638.698531:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790772638.698573:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772638.698649:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772638.698695:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328ae568900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.699288:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813402880 00000100:00100000:0.0:1790772638.699298:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813402880 00000100:00100000:0.0:1790772638.699357:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790772638.699366:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c14a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772638.699581:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c14a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813402880:12345-0@lo:502:mount.lustre.0 Request processed in 215us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.699589:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772638.699779:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813402880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790772638.700073:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790772638.700088:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790772638.704153:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772638.704169:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772638.704172:0:15736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790772638.704180:0:15736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff932891907000 00000020:00000080:1.0:1790772638.704182:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772638.704191:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772638.704194:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772638.704195:0:15736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790772638.704197:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772638.704200:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772638.704201:0:15736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790772638.704205:0:15736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff932891907000 00000020:00000080:1.0:1790772638.704207:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772638.704318:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772638.704323:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772638.704324:0:15736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790772638.704328:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772638.704330:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772638.704331:0:15736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790772638.704335:0:15736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff932891907000 00000020:00000080:1.0:1790772638.704337:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772638.708144:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772638.708157:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772638.708159:0:15736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790772638.708164:0:15736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1790772638.711845:0:15731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790772638.711915:0:15731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772638.711932:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.711956:0:15731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772638.712031:0:15731:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790772638.712035:0:15731:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff932891907000 10000000:01000000:0.0:1790772638.712039:0:15731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff932891907000 10000000:01000000:0.0:1790772638.712043:0:15731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790772638.712050:0:15731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff932891907000 from 1 10000000:01000000:0.0:1790772638.712053:0:15731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790772638.712102:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.712111:0:15731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.712123:0:15731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772638.712155:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772638.712228:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772638.712272:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a04b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.712298:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403008 00000100:00100000:0.0:1790772638.712305:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403008 00000100:00100000:0.0:1790772638.712347:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790772638.712356:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c14a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813403008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772638.712369:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772638.712383:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93289ed93800/0xd3c7635991be2779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2772 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.712419:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed93800/0xd3c7635991be2779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2772 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.712555:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93289ed93800/0xd3c7635991be2779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2772 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.712565:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed93800, rc 0) 00000100:00100000:0.0:1790772638.712608:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c14a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403008:12345-0@lo:101:mount.lustre.0 Request processed in 253us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.712616:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790772638.712669:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772638.712684:0:15731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2779 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.712694:0:15731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2779 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772638.716456:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1790772638.717784:0:15731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772638.718311:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790772638.718361:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790772638.718394:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790772638.718704:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790772638.718750:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790772638.718799:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790772638.718977:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790772638.719020:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790772638.719073:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790772638.719131:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790772638.719170:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790772638.719241:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790772638.719282:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790772638.719323:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790772638.719378:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790772638.719416:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790772638.719465:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790772638.719515:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790772638.719550:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790772638.719584:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790772638.719634:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790772638.719672:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790772638.719707:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790772638.719758:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790772638.719796:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1790772638.719847:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1790772638.719928:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1790772638.719966:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1790772638.720001:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1790772638.720050:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1790772638.720086:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1790772638.720120:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1790772638.720158:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1790772638.720208:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1790772638.720247:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1790772638.720296:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1790772638.720335:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1790772638.720433:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1790772638.720442:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1790772638.720553:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772638.720628:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772638.720699:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a04b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.720922:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403136 00000100:00100000:2.0:1790772638.720931:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403136 00000100:00100000:2.0:1790772638.720984:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772638.720993:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c14a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772638.721243:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c14a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403136:12345-0@lo:501:mount.lustre.0 Request processed in 250us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.721251:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790772638.724626:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772638.724689:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772638.724766:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772638.724810:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a04b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.725072:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403264 00000100:00100000:2.0:1790772638.725081:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403264 00000100:00100000:2.0:1790772638.725133:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772638.725143:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772638.725794:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403264:12345-0@lo:503:mount.lustre.0 Request processed in 650us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.725803:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790772638.726582:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790772638.730338:0:15731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772638.731559:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772638.731641:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772638.731695:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403392 00000100:00100000:0.0:1790772638.731703:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403392 00000100:00100000:0.0:1790772638.731754:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790772638.731764:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772638.732996:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a04b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.733339:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403392:12345-0@lo:502:mount.lustre.0 Request processed in 1574us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.733348:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772638.736781:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772638.737188:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790772638.737260:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790772638.737290:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790772638.737330:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790772638.737364:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790772638.737405:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790772638.737440:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790772638.737476:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790772638.737528:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790772638.737564:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790772638.737596:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790772638.737646:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790772638.737682:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790772638.737725:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790772638.737790:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790772638.737825:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790772638.737900:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790772638.737955:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790772638.737995:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790772638.738322:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790772638.738384:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790772638.738424:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790772638.738459:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790772638.738509:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790772638.738546:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790772638.738582:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790772638.738633:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790772638.738673:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790772638.739314:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790772638.739385:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790772638.739436:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790772638.739472:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790772638.739504:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790772638.739572:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790772638.739608:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790772638.739650:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790772638.739683:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790772638.741125:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790772638.743377:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790772638.743477:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790772638.743528:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772638.743607:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772638.743642:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85240 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.745539:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403520 00000100:00100000:0.0:1790772638.745552:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403520 00000100:00100000:0.0:1790772638.745612:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790772638.745622:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772638.747143:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403520:12345-0@lo:502:mount.lustre.0 Request processed in 1517us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.747156:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772638.752685:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772638.752858:0:15731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790772638.753131:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790772638.754622:0:15740:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790772638.754639:0:15740:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9328833f0000) 00000020:00000080:1.0:1790772638.754671:0:15740:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1790772638.754763:0:15740:0:(tgt_mount.c:153:server_get_mount()) get mount ffff932891907000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790772638.754768:0:15740:0:(tgt_mount.c:187:server_put_mount()) put mount ffff932891907000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790772638.754771:0:15740:0:(obd_mount.c:710:lustre_put_lsi()) put ffff932891907000 3 00010000:00080000:1.0:1790772638.754801:0:15740:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93278309f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1790772638.761306:0:15740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1790772638.762713:0:15740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790772638.762772:0:15740:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772638.762786:0:15740:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd3c7635991be2787 00000100:00080000:2.0:1790772638.762796:0:15740:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772638.762811:0:15740:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93278309f800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1790772638.762870:0:15740:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9328bf51c380 x1877760813403648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772638.763553:0:15740:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790772638.764137:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1877760813403648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790772638.764213:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.764530:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403648 00000100:00100000:3.0:1790772638.764539:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403648 00000100:00100000:3.0:1790772638.764578:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772638.764585:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1877760813403648:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790772638.764611:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1790772638.764653:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd3c7635991be278e 00000004:00100000:3.0:1790772638.764669:0:14327:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790772638.764702:0:14327:0:(import.c:65:import_set_state_nolock()) ffff932884be3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772638.764765:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877760813403648:12345-0@lo:38:llog_process_th.0 Request processed in 178us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772638.764771:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790772638.765000:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9328bf51c380 x1877760813403648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772638.765011:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772638.765019:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790772638.765026:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790772638.765030:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790772638.765032:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93278309f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772638.765038:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1877760813403648:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790772638.765155:0:15740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790772638.765550:0:15731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790772638.765582:0:15731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790772638.765639:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2779 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.765649:0:15731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93289ed93600/0xd3c7635991be2772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2779 expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790772638.765695:0:15731:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790772638.765698:0:15731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790772638.765699:0:15731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772638.765700:0:15731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772638.765701:0:15731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772638.765703:0:15731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772638.765704:0:15731:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772638.765706:0:15731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772638.765708:0:15731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790772638.765711:0:15731:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790772638.765714:0:15731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772638.765715:0:15731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790772638.765716:0:15731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772638.765717:0:15731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772638.765718:0:15731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772638.765719:0:15731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772638.765720:0:15731:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772638.765721:0:15731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772638.765722:0:15731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790772638.765741:0:15731:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790772638.765756:0:15731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772638.765806:0:15731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.765840:0:15731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bfaec600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772638.767013:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403776 00000100:00100000:0.0:1790772638.767023:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403776 00000100:00100000:0.0:1790772638.767075:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790772638.767089:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:15731:x1877760813403776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790772638.767120:0:14320:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790772638.767137:0:14320:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790772638.795225:0:14320:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790772638.795240:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790772638.795261:0:14341:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790772638.795266:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790772638.795289:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.795308:0:14341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2661 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.795318:0:14341:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.795360:0:14341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be2661 expref: 19 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772638.795377:0:14341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be2661 expref: 19 pid: 14320 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772638.795394:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14341:1877760813403904:0@lo:104: 00000100:00100000:3.0:1790772638.795677:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772638.795759:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328918426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772638.796173:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813403904 00000100:00100000:2.0:1790772638.796183:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813403904 00000100:00100000:2.0:1790772638.796234:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772638.796244:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14341:x1877760813403904:12345-0@lo:104: 00010000:00010000:2.0:1790772638.796258:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772638.796401:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772638.796408:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d178e578-a8f2-4768-8767-0ddb2fe17697+3:14341:x1877760813403904:12345-0@lo:104: Request processed in 166us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772638.796415:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790772638.796541:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772638.796549:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796557:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9c00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772638.796561:0:15493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796570:0:15493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772638.796577:0:15493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772638.796583:0:15493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772638.796622:0:15493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796629:0:15493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772638.796647:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796652:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9c00/0xd3c7635991be2661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2668 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796669:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772638.796670:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772638.796687:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772638.796739:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d178e578-a8f2-4768-8767-0ddb2fe17697:3317:1877760813404032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772638.796774:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772638.796864:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404032 00000100:00100000:0.0:1790772638.796869:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404032 00010000:00010000:0.0:1790772638.796928:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2661 expref: 20 pid: 14320 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772638.796951:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772638.796957:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+20:3317:x1877760813404032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772638.796968:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772638.796972:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2661 expref: 20 pid: 14320 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796980:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be2661 expref: 20 pid: 14320 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.796996:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797003:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772638.797015:0:14312:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006467262s 00010000:00010000:0.0:1790772638.797019:0:14312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797025:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797031:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797036:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797049:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772638.797053:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797061:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797069:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772638.797078:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772638.797110:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+20:3317:x1877760813404032:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772638.797117:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772638.797265:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d178e578-a8f2-4768-8767-0ddb2fe17697:3317:1877760813404032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772638.798191:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328b974d600/0xd3c7635991be2668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be2661 expref: 19 pid: 14320 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772638.798205:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14341:1877760813403904:0@lo:104: 00010000:00010000:1.0:1790772638.798222:0:14341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.798231:0:14341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.798237:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772638.798257:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e8800/0xd3c7635991be2795 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772638.804404:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:15731:x1877760813403776:12345-0@lo:253:mount.lustre.0 Request processed in 37307us (38589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772638.804420:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790772638.804642:0:15731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d178e578-a8f2-4768-8767-0ddb2fe17697:15731:1877760813403776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772638.804672:0:15731:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790772638.804675:0:15731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772638.804677:0:15731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772638.804678:0:15731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772638.804679:0:15731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772638.804680:0:15731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772638.804681:0:15731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772638.804683:0:15731:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772638.804685:0:15731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772638.804686:0:15731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772638.804699:0:15731:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790772638.815117:0:15731:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772638.815284:0:15731:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772638.816286:0:15731:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772638.816674:0:15731:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772638.816987:0:15731:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772638.817223:0:15731:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790772638.818727:0:15731:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790772638.881226:0:15731:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790772638.881236:0:15731:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790772638.881278:0:15731:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772638.881337:0:15731:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772638.881356:0:15731:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790772638.881388:0:15731:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790772639.568375:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790772640.267947:0:14322:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772640.267958:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93288694b000 from 8 10000000:01000000:2.0:1790772640.267974:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772640.268029:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772640.268042:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772640.268054:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772640.268080:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813404160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772640.268157:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772640.268233:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328900f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772640.268694:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404160 00000100:00100000:0.0:1790772640.268705:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404160 00000100:00100000:0.0:1790772640.268802:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790772640.268823:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813404160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772640.268838:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772640.268855:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93289ed92400/0xd3c7635991be27a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be279c expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772640.268913:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93289ed92400/0xd3c7635991be27a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be279c expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772640.268923:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93289ed92400/0xd3c7635991be27a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be279c expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772640.268933:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93289ed92400, rc 0) 00000100:00100000:0.0:1790772640.268996:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813404160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772640.269003:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772640.269062:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813404160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772640.269081:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be27a3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772640.269091:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be27a3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772640.269142:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813404288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790772640.269172:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772640.279200:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328900f7840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772640.280658:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404288 00000100:00100000:3.0:1790772640.280672:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404288 00000100:00100000:3.0:1790772640.282134:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772640.282158:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813404288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790772640.282187:0:14319:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790772640.282212:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790772640.282216:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790772640.282377:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813404288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 229us (13203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772640.282385:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790772640.282910:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813404288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790772640.282982:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790772640.282993:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be27a3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772640.283004:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328b974c800/0xd3c7635991be279c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be27a3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772640.588046:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772640.844650:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772641.611009:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772642.635151:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772643.531833:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813404416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772643.531938:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772643.532132:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404416 00000100:00100000:3.0:1790772643.532150:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404416 00000100:00100000:3.0:1790772643.532213:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772643.532223:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813404416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772643.532256:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772643.532302:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813404416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772643.532308:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790772643.532606:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772643.532840:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790772643.532863:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813404416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790772643.659253:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790772644.043006:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772644.043013:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772644.043017:0:37:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772644.043025:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1790772644.043030:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790772644.043043:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932894ae3000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1790772644.043069:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93288f0cea00 x1877760813404672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772644.043140:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813404672:0@lo:8:kworker.0 00000100:00100000:0.0:1790772644.043211:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772644.043276:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813404928:0@lo:400:kworker.0 00000100:00100000:0.0:1790772644.043304:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772644.043325:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772644.043330:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813405056:0@lo:400:kworker.0 00000100:00100000:0.0:1790772644.043352:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772644.043388:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404672 00000100:00100000:0.0:1790772644.043396:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404672 00000100:00100000:0.0:1790772644.043429:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772644.043436:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1877760813404672:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790772644.043477:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1790772644.043508:0:15011:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd3c7635991be27aa 00002000:00100000:0.0:1790772644.043530:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff932888227000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790772644.043535:0:15011:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790772644.043538:0:15011:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790772644.043912:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790772644.043937:0:15011:0:(import.c:65:import_set_state_nolock()) ffff932888221000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772644.043990:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1877760813404672:12345-0@lo:8:kworker.0 Request processed in 552us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772644.043997:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772644.044038:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404928 00000100:00100000:0.0:1790772644.044043:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404928 00000100:00100000:0.0:1790772644.044080:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405056 00000100:00100000:0.0:1790772644.044084:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405056 00000100:00100000:0.0:1790772644.044098:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772644.044104:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813404928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772644.044142:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1877760813404928:12345-0@lo:400:kworker.0 Request processed in 37us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772644.044148:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772644.044161:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772644.044167:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813405056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772644.044195:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813405056:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772644.044200:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790772644.044222:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772644.044253:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cdc00 x1877760813405056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772644.044266:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813405056:0@lo:400:kworker.0 00010000:00080000:0.0:1790772644.044278:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cc700 x1877760813404928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772644.044293:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1877760813404928:0@lo:400:kworker.0 00010000:00080000:0.0:1790772644.044323:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cea00 x1877760813404672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772644.044330:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772644.044335:0:3314:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790772644.044342:0:3314:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790772644.044347:0:3314:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790772644.044349:0:3314:0:(import.c:65:import_set_state_nolock()) ffff932894ae3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790772644.044361:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790772644.044365:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1877760813404672:0@lo:8:kworker.0 00000004:00080000:0.0:1790772644.044397:0:14350:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1790772644.044412:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14350:1877760813405312:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790772644.044437:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772644.044455:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328b9894840 going to sleep for 11 seconds 00000004:00080000:0.0:1790772644.044468:0:14349:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790772644.044846:0:14349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464864970187ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790772644.044870:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405312 00000100:00100000:0.0:1790772644.044895:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405312 00000100:00100000:0.0:1790772644.044927:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772644.044933:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14350:x1877760813405312:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790772644.045734:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813404800:0@lo:400:kworker.0 00000100:00100000:1.0:1790772644.045799:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772644.045831:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790772644.045837:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813404544:0@lo:400:kworker.0 00000100:00100000:1.0:1790772644.045863:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772644.045914:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813405184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772644.045936:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772644.046983:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404544 00000100:00100000:2.0:1790772644.046993:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404544 00000100:00100000:3.0:1790772644.047143:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405184 00000100:00100000:3.0:1790772644.047148:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405184 00000100:00100000:3.0:1790772644.047181:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772644.047189:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813405184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772644.047220:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772644.047283:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1877760813405184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772644.047290:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790772644.047370:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cea00 x1877760813405184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772644.047390:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813405184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772644.048691:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790772644.048706:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3316:x1877760813404544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772644.048804:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3316:x1877760813404544:12345-0@lo:400:kworker.0 Request processed in 102us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772644.048812:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00002000:00080000:0.0:1790772644.054100:0:15008:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1790772644.054113:0:15008:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1790772644.054118:0:15008:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:2.0:1790772644.059129:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813404544:0@lo:400:kworker.0 00000100:00080000:1.0:1790772644.074734:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772644.097299:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813404800 00000100:00100000:0.0:1790772644.097313:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813404800 00000100:00100000:0.0:1790772644.097374:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772644.097384:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813404800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772644.097482:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1877760813404800:12345-0@lo:400:kworker.0 Request processed in 99us (51682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772644.097490:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790772644.097541:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93288f0cce00 x1877760813404800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772644.097556:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1877760813404800:0@lo:400:kworker.0 00002000:00010000:0.0:1790772644.098036:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.098045:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098061:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.098065:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.098072:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098089:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098098:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098106:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098135:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.098148:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.098153:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098160:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.098164:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098173:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098187:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098195:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73e8f04/0xd3c7635991be27b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098213:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.098215:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.098216:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.098680:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.098687:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098697:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.098706:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.098712:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098721:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098730:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098736:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098771:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.098781:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.098785:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098792:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.098795:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098802:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098812:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098831:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009588fb75/0xd3c7635991be27b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.098844:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.098846:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.098847:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.099272:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.099279:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099287:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.099290:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.099293:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099301:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099308:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099315:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099331:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.099339:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.099349:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099356:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93c00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.099359:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099367:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099377:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099384:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e50765/0xd3c7635991be27bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099402:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.099404:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.099405:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.099834:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.099841:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099849:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.099853:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.099857:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099902:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099911:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099918:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099932:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.099941:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.099945:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099952:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93e00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.099955:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099962:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099972:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.099979:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6381e69/0xd3c7635991be27c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100001:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.100003:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.100005:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.100404:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.100410:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100418:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.100421:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.100426:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100433:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100440:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100447:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100461:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.100470:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.100475:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100493:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.100496:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100504:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100514:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100520:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed56ea89/0xd3c7635991be27cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.100534:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.100536:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.100537:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.119386:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.119401:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119422:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.119427:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.119434:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119448:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119469:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119478:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119503:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.119522:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.119527:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119536:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.119541:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119550:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119567:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119576:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e222130d/0xd3c7635991be27d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.119602:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.119610:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.119612:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.122774:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.124444:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124467:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.124472:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.124479:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124493:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124505:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124513:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124533:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.124548:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.124554:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124563:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92e00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.124567:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124590:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124606:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124614:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cf2b834/0xd3c7635991be27db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.124634:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.124636:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.124638:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.125263:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.125275:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125287:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.125289:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.125294:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125302:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125310:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125323:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125340:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.125350:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.125355:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125361:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.125365:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125372:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125383:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125390:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e56f97b2/0xd3c7635991be27e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.125404:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.125406:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.125407:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.126757:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.126776:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126790:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.126794:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.126800:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126812:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126820:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126829:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126845:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.126855:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.126860:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126868:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed92a00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.126887:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126897:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126919:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126926:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3bbb3fd/0xd3c7635991be27e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.126942:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.126943:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.126945:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.127544:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.127550:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127560:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.127563:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.127567:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127577:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127585:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127592:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127618:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.127628:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.127632:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127639:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93289ed93000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.127642:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127649:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127661:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127668:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047768394/0xd3c7635991be27f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.127687:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.127689:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.127690:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.128604:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.128612:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128623:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.128632:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.128637:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128649:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128658:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128665:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128680:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.128691:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.128696:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128703:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.128706:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128714:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128724:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128753:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be27f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.128769:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.128770:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.128772:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.129456:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.129465:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.129475:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.129479:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.129484:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.129494:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.129503:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.129511:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.129537:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772644.131188:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772644.131201:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.131214:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bee00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772644.131218:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.131229:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.131254:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.131270:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094eff822/0xd3c7635991be27fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.131291:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.131293:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.131294:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.138934:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.138954:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.138971:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.138975:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.138980:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.138994:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139003:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139010:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139028:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.139041:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.139046:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139054:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.139059:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139067:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139091:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139098:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005063b35d/0xd3c7635991be2805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.139116:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.139118:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.139120:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.143358:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.143371:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143388:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.143393:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.143399:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143413:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143424:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143433:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143466:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.143480:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.143486:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143494:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.143498:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143508:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143525:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143533:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050568579/0xd3c7635991be280c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.143551:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.143553:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.143554:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.144034:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.144042:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.144051:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.144060:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.144065:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.144076:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.144085:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.144093:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.144109:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.144119:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.144123:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.146277:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bea00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.146284:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.146297:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.146318:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.146339:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e84293/0xd3c7635991be2813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.146363:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.146365:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.146368:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.146983:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.146990:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.147003:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.147007:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.147014:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.147026:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.147036:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.147043:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.147066:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772644.147892:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772644.147901:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.147912:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772644.147916:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.147926:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.147942:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.147949:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5c4ccba/0xd3c7635991be281a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.147965:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.147967:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.147968:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.149812:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.149832:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149849:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.149854:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.149861:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149893:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149903:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149910:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149928:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.149940:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.149946:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149955:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.149958:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149967:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149990:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.149997:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000916592c4/0xd3c7635991be2821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150013:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.150015:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.150017:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.150422:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.150430:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150438:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.150441:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.150445:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150453:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150461:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150468:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150494:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.150503:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.150508:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150514:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be800 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.150517:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150524:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150534:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150541:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e1d17ad/0xd3c7635991be2828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.150554:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.150556:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.150557:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.151002:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.151009:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151018:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.151027:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.151032:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151043:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151052:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151059:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151080:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790772644.151457:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.151463:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151472:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.151474:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.151479:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151488:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151496:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151509:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151523:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790772644.151532:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772644.151537:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151544:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfc00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.151547:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151554:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151566:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151573:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000823c949e/0xd3c7635991be282f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151588:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.151591:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151609:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf000 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.151612:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151619:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151629:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151636:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3df758c/0xd3c7635991be2836 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.151648:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.151649:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.151651:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.152076:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.152082:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152091:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.152094:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.152098:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152107:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152121:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152128:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152142:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.152150:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.152154:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152160:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf400 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.152162:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152169:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152180:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152187:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be283d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152200:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.152209:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.152211:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.152613:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.152620:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152628:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.152631:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.152635:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152644:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152651:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152659:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152673:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.152681:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.152684:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152691:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfe00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.152695:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152712:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152724:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.152732:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008be207a8/0xd3c7635991be2844 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.153547:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.160338:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.160341:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.160344:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.163945:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.163959:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.163978:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.163982:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.163990:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164003:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164014:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164033:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164052:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772644.164670:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772644.164681:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164692:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772644.164698:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164721:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164748:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164756:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c9afb26/0xd3c7635991be284b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.164776:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.164778:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.164780:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.165593:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.165611:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.165623:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.165628:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.165635:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.165646:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.165654:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.165662:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.165682:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772644.166474:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772644.166483:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.166494:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772644.166498:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.166507:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.166522:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.166530:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043a1533b/0xd3c7635991be2852 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.166547:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.166549:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.166551:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790772644.167222:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.167231:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.167243:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.167247:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.167254:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.167265:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.167282:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.167289:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.167313:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790772644.167709:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.167716:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.167724:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.167726:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.167730:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.168425:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772644.168433:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.168442:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bec00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772644.168446:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.168467:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.168483:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.168490:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6b1343b/0xd3c7635991be2859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.168510:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.168512:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.168514:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772644.170314:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.170335:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.170343:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.170391:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790772644.171052:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772644.171061:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.171074:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1790772644.171078:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772644.171085:0:15008:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.171095:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.171103:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.171110:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772644.171123:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790772644.171237:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772644.171245:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171252:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfa00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772644.171257:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171266:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171283:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171301:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856b6df0/0xd3c7635991be2860 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171323:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772644.171326:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171333:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be600 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:1.0:1790772644.171336:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171343:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171353:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171359:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e38ca45/0xd3c7635991be2867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772644.171371:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.171372:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.171374:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772644.171381:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790772644.171595:0:15008:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1790772644.171698:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14350:x1877760813405312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 126761us (127257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772644.171708:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772644.172547:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14350:1877760813405312:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790772644.172575:0:14350:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1790772644.172619:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf628a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14350:1877760813405440:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790772644.172660:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772644.172708:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772644.172843:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405440 00000100:00100000:0.0:1790772644.172857:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405440 00000100:00100000:0.0:1790772644.172991:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772644.173000:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14350:x1877760813405440:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790772644.173043:0:15010:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000001:00100000:3.0:1790772644.185362:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790772644.193551:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14350:x1877760813405440:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20542us (20879us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790772644.193566:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772644.193629:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf628a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14350:1877760813405440:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790772644.193645:0:14350:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1790772644.195950:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1790772644.692530:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772645.710165:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772646.070550:0:16088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790772646.731126:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772647.756063:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772648.661951:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772648.661974:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813405568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772648.662047:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772648.662129:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405568 00000100:00100000:1.0:1790772648.662138:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405568 00000100:00100000:1.0:1790772648.662200:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772648.662210:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813405568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772648.662246:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772648.662292:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813405568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772648.662299:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790772648.662320:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772648.662355:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813405568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772648.778975:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772649.108705:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772649.108913:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796630784 00000100:00100000:1.0:1790772649.108928:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796630784 00000100:00100000:1.0:1790772649.108982:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1790772649.108992:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1877760796630784:12345-192.168.201.34@tcp:250:mount.lustre.0 00010000:00080000:1.0:1790772649.109030:0:14320:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e31b6460-4591-4d63-a470-ddffcd27dc7d@192.168.201.34@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1790772649.109075:0:14320:0:(genops.c:1384:class_connect()) connect: client e31b6460-4591-4d63-a470-ddffcd27dc7d, cookie 0xd3c7635991be286e 00000100:00080000:1.0:1790772649.109272:0:14320:0:(import.c:65:import_set_state_nolock()) ffff932783098800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772649.109351:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+5:2353:x1877760796630784:12345-192.168.201.34@tcp:250:mount.lustre.0 Request processed in 359us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772649.109368:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:2.0:1790772649.120973:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772649.121593:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796630912 00000100:00100000:3.0:1790772649.121606:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796630912 00000100:00100000:3.0:1790772649.121745:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:3.0:1790772649.121757:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+5:13705:x1877760796630912:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772649.121776:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772649.121795:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9600/0xd3c7635991be2875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50c0d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772649.121824:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9600/0xd3c7635991be2875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c0d expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772649.121835:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9600/0xd3c7635991be2875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c0d expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772649.121844:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9600, rc 0) 00000100:00100000:3.0:1790772649.121956:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+6:13705:x1877760796630912:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 201us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.121963:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:0.0:1790772649.130965:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772649.131124:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631040 00000100:00100000:2.0:1790772649.131135:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631040 00000100:00100000:2.0:1790772649.131179:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1790772649.131189:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+6:13705:x1877760796631040:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790772649.131489:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+6:13705:x1877760796631040:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 300us (531us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772649.131497:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1790772649.140294:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772649.140398:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631168 00000100:00100000:1.0:1790772649.140411:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631168 00000100:00100000:1.0:1790772649.140482:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1790772649.140493:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+6:13705:x1877760796631168:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772649.140514:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772649.140545:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da400/0xd3c7635991be287c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50c14 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772649.140575:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da400/0xd3c7635991be287c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c14 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772649.140588:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da400/0xd3c7635991be287c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c14 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772649.140597:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da400, rc 0) 00000100:00100000:1.0:1790772649.140686:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+7:13705:x1877760796631168:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 195us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772649.140694:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:2.0:1790772649.158690:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772649.158858:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631296 00000100:00100000:3.0:1790772649.158869:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631296 00000100:00100000:3.0:1790772649.158975:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:3.0:1790772649.158985:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+7:13705:x1877760796631296:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772649.159331:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13705:x1877760796631296:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 345us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.159339:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:3.0:1790772649.163546:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813405696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772649.163618:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772649.165298:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405696 00000100:00100000:2.0:1790772649.165312:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405696 00000100:00100000:2.0:1790772649.165402:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772649.165414:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813405696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772649.165456:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772649.165538:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1877760813405696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.165546:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790772649.168609:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772649.168928:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813405696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772649.169508:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813405952:0@lo:400:kworker.0 00000100:00100000:1.0:1790772649.169569:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772649.169599:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772649.169606:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813406080:0@lo:400:kworker.0 00000100:00100000:1.0:1790772649.170489:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772649.170909:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813406208:0@lo:400:kworker.0 00000100:00100000:3.0:1790772649.170948:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772649.170981:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772649.170987:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d178e578-a8f2-4768-8767-0ddb2fe17697:3317:1877760813405824:0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.171560:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405952 00000100:00100000:0.0:1790772649.171570:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405952 00000100:00100000:0.0:1790772649.171610:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406080 00000100:00100000:0.0:1790772649.171614:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406080 00000100:00100000:0.0:1790772649.171667:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406208 00000100:00100000:0.0:1790772649.171670:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406208 00000100:00100000:0.0:1790772649.171686:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772649.171695:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813405952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.171758:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813405952:12345-0@lo:400:kworker.0 Request processed in 64us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772649.171766:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772649.171786:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772649.171793:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813406080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.171839:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813406080:12345-0@lo:400:kworker.0 Request processed in 47us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772649.171844:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772649.172065:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772649.172960:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813406208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790772649.173090:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772649.186843:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00080000:0.0:1790772649.193216:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bf62b480 x1877760813406080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772649.193238:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813406080:0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.194833:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813406208:12345-0@lo:400:kworker.0 Request processed in 22752us (23873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772649.194852:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790772649.194937:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bf62a300 x1877760813405952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772649.194952:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813405952:0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.195090:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790772649.195137:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9328bf62a680 x1877760813406208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772649.195146:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813406208:0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.199263:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813405824 00000100:00100000:0.0:1790772649.199277:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813405824 00000100:00100000:0.0:1790772649.199338:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790772649.199347:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3317:x1877760813405824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772649.199434:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3317:x1877760813405824:12345-0@lo:400:kworker.0 Request processed in 87us (4343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772649.199453:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790772649.199523:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d178e578-a8f2-4768-8767-0ddb2fe17697:3317:1877760813405824:0@lo:400:kworker.0 00000100:00100000:1.0:1790772649.228437:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631424 00000100:00100000:1.0:1790772649.228453:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631424 00000100:00100000:1.0:1790772649.228506:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:1.0:1790772649.228516:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13705:x1877760796631424:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790772649.228858:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f242c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13705:x1877760796631424:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 332us (42012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772649.228867:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:2.0:1790772649.235999:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772649.236090:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631552 00000100:00100000:0.0:1790772649.236100:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631552 00000100:00100000:0.0:1790772649.236151:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:0.0:1790772649.236161:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13723:x1877760796631552:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772649.236519:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f243050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13723:x1877760796631552:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 358us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772649.236527:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1790772649.298674:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772649.298738:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631680 00000100:00100000:2.0:1790772649.298748:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631680 00000100:00100000:2.0:1790772649.306661:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1790772649.306685:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289f241450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13723:x1877760796631680:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772649.307039:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289f241450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13723:x1877760796631680:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 364us (8374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.307049:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1790772649.312529:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772649.312724:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631808 00000100:00100000:3.0:1790772649.312736:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631808 00000100:00100000:3.0:1790772649.312795:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1790772649.312806:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932899caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+8:13705:x1877760796631808:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772649.312824:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772649.312843:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e8c00/0xd3c7635991be2883 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50c3e expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772649.312904:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e8c00/0xd3c7635991be2883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c3e expref: 9 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772649.312916:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e8c00/0xd3c7635991be2883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c3e expref: 9 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772649.312925:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8c00, rc 0) 00000100:00100000:3.0:1790772649.313011:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932899caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+9:13705:x1877760796631808:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 206us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.313019:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000001:00080000:2.0:1790772649.329796:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1790772649.404093:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772649.404214:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796631936 00000100:00100000:0.0:1790772649.404235:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796631936 00000100:00100000:0.0:1790772649.404294:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1790772649.404304:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932890770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+9:13705:x1877760796631936:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790772649.404332:0:14319:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790772649.404369:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790772649.404374:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790772649.404378:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790772649.404381:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790772649.408133:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932890770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+9:13705:x1877760796631936:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 3818us (4038us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772649.408148:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:1.0:1790772649.412872:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772649.413101:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632064 00000100:00100000:2.0:1790772649.413110:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632064 00000100:00100000:2.0:1790772649.413262:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:2.0:1790772649.413273:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff932890773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+9:13705:x1877760796632064:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772649.413290:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772649.413307:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50c45 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.413334:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.413345:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 10 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.413364:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d600, rc 0) 00000100:00100000:2.0:1790772649.413421:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff932890773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13705:x1877760796632064:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 150us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.413428:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:1.0:1790772649.423432:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772649.428576:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632192 00000100:00100000:3.0:1790772649.428591:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632192 00000100:00100000:3.0:1790772649.428674:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:3.0:1790772649.428686:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13705:x1877760796632192:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772649.430121:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13705:x1877760796632192:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 1433us (6692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.430132:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:3.0:1790772649.433481:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772649.433943:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632320 00000100:00100000:0.0:1790772649.433954:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632320 00000100:00100000:2.0:1790772649.436673:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:3.0:1790772649.441860:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13705:x1877760796632320:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790772649.444474:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13705:x1877760796632320:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 7692us (10992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.444489:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1790772649.455749:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772649.455854:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632448 00000100:00100000:1.0:1790772649.455865:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632448 00000100:00100000:1.0:1790772649.455962:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:1.0:1790772649.455973:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13728:x1877760796632448:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772649.458140:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13728:x1877760796632448:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 2158us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772649.458153:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:0.0:1790772649.469374:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772649.469462:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632576 00000100:00100000:3.0:1790772649.469473:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632576 00000100:00100000:3.0:1790772649.469539:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:3.0:1790772649.469550:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13728:x1877760796632576:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772649.469817:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13728:x1877760796632576:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 268us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.469826:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:3.0:1790772649.484363:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772649.484865:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632704 00000100:00100000:1.0:1790772649.484924:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632704 00000100:00100000:1.0:1790772649.484969:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1790772649.484978:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1877760796632704:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790772649.485007:0:14326:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c2c98cc0-3117-4d23-8350-1bdc44edcae4@192.168.201.34@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1790772649.485055:0:14326:0:(genops.c:1384:class_connect()) connect: client c2c98cc0-3117-4d23-8350-1bdc44edcae4, cookie 0xd3c7635991be2891 00000004:00100000:1.0:1790772649.485088:0:14326:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790772649.485107:0:14326:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1790772649.575341:0:14326:0:(import.c:65:import_set_state_nolock()) ffff932891b60800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772649.575633:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2353:x1877760796632704:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 90652us (91288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.575657:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1790772649.582418:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772649.582549:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632832 00000100:00100000:2.0:1790772649.582559:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632832 00000100:00100000:2.0:1790772649.582636:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1790772649.582656:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:0:x1877760796632832:12345-192.168.201.34@tcp:41:mount.lustre.0 00000100:00080000:0.0:1790772649.582829:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1790772649.582905:0:14325:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790772649.583052:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:0:x1877760796632832:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 407us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.583483:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1790772649.593608:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772649.593782:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796632960 00000100:00100000:2.0:1790772649.593793:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796632960 00000100:00100000:2.0:1790772649.593852:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1790772649.593861:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13705:x1877760796632960:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790772649.593927:0:14326:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790772649.593997:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13705:x1877760796632960:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 136us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.594004:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1790772649.596253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772649.601530:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633088 00000100:00100000:1.0:1790772649.601546:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633088 00000100:00100000:2.0:1790772649.601952:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1790772649.601963:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13705:x1877760796633088:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790772649.602098:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13705:x1877760796633088:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 135us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.602106:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1790772649.607718:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772649.607764:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772649.607869:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633216 00000100:00100000:0.0:1790772649.607912:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633216 00000100:00100000:2.0:1790772649.608550:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633344 00000100:00100000:2.0:1790772649.608555:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633344 00000100:00100000:2.0:1790772649.608600:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1790772649.608609:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1877760796633344:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790772649.608653:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c2c98cc0-3117-4d23-8350-1bdc44edcae4@192.168.201.34@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1790772649.608688:0:15011:0:(genops.c:1384:class_connect()) connect: client c2c98cc0-3117-4d23-8350-1bdc44edcae4, cookie 0xd3c7635991be2898 00002000:00100000:2.0:1790772649.608701:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2c98cc0-3117-4d23-8350-1bdc44edcae4/ffff932884be0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790772649.608712:0:15011:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790772649.609768:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772649.609809:0:15011:0:(import.c:65:import_set_state_nolock()) ffff932884be3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772649.609990:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2353:x1877760796633344:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 1379us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.610000:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1790772649.610310:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1790772649.610330:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1877760796633216:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790772649.610364:0:15008:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c2c98cc0-3117-4d23-8350-1bdc44edcae4@192.168.201.34@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1790772649.610387:0:15008:0:(genops.c:1384:class_connect()) connect: client c2c98cc0-3117-4d23-8350-1bdc44edcae4, cookie 0xd3c7635991be289f 00002000:00100000:3.0:1790772649.610397:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2c98cc0-3117-4d23-8350-1bdc44edcae4/ffff9328bf5f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772649.610406:0:15008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772649.610662:0:15008:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790772649.610683:0:15008:0:(import.c:65:import_set_state_nolock()) ffff9328bf5f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772649.610718:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2353:x1877760796633216:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 387us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772649.610725:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1790772649.621280:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772649.621739:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633472 00000100:00100000:3.0:1790772649.621751:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633472 00000100:00100000:3.0:1790772649.621813:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1790772649.621825:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13705:x1877760796633472:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790772649.627726:0:14328:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5789us 00000004:00200000:1.0:1790772649.657719:0:14328:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790772649.657866:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13705:x1877760796633472:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 36037us (36589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772649.657937:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00010000:00010000:1.0:1790772649.807843:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772649.991276:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772649.991526:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633600 00000100:00100000:2.0:1790772649.991537:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633600 00000100:00100000:2.0:1790772649.991603:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1790772649.991614:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13749:x1877760796633600:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:2.0:1790772649.991644:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772649.991673:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974ca00/0xd3c7635991be28a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50c6f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.991740:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be28ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.991755:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be28ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.991788:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be28ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772649.991825:0:14325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772649.991828:0:14325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772649.991867:0:14325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be28ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.991924:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974ca00/0xd3c7635991be28a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c6f expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.991945:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be28ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c6f expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772649.991953:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:2.0:1790772649.991956:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772649.991960:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974de00, rc 0) 00000100:00100000:2.0:1790772649.992028:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:13749:x1877760796633600:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 416us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772649.992037:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000040:00080000:1.0:1790772650.059786:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772650.827182:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772651.851071:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772652.439912:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772652.439993:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633728 00000100:00100000:0.0:1790772652.440003:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633728 00000100:00100000:0.0:1790772652.440072:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1790772652.440082:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:13802:x1877760796633728:12345-192.168.201.34@tcp:41:lfs.0 00000004:00000024:0.0:1790772652.440125:0:14326:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790772652.440231:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:13802:x1877760796633728:12345-192.168.201.34@tcp:41:lfs.0 Request processed in 151us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772652.440239:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:2.0:1790772652.441552:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772652.443934:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.444084:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633856 00000100:00100000:2.0:1790772652.444095:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633856 00000100:00100000:2.0:1790772652.444167:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1790772652.444178:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13802:x1877760796633856:12345-192.168.201.34@tcp:13:lfs.0 00000100:00080000:0.0:1790772652.444823:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790772652.445493:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772652.445613:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13802:x1877760796633856:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 1434us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.445623:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1790772652.457822:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772652.457984:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796633984 00000100:00100000:0.0:1790772652.457995:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796633984 00000100:00100000:0.0:1790772652.461747:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1790772652.461763:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13802:x1877760796633984:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:0.0:1790772652.461805:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772652.461914:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:13802:x1877760796633984:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 155us (4101us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772652.461922:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00080000:2.0:1790772652.461999:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772652.719165:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772652.719310:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634112 00000100:00100000:1.0:1790772652.719321:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634112 00000100:00100000:1.0:1790772652.719378:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:1.0:1790772652.719388:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+10:13833:x1877760796634112:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772652.719404:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772652.719422:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be28b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50c76 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772652.719451:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be28b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c76 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772652.719463:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4dba00/0xd3c7635991be28b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c76 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772652.719490:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dba00, rc 0) 00000100:00100000:1.0:1790772652.719558:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13833:x1877760796634112:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 171us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772652.719566:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:1.0:1790772652.730577:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.730653:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634240 00000100:00100000:2.0:1790772652.730665:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634240 00000100:00100000:2.0:1790772652.730723:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:2.0:1790772652.730733:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13833:x1877760796634240:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790772652.731064:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13833:x1877760796634240:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 332us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.731073:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1790772652.735612:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772652.736700:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634368 00000100:00100000:3.0:1790772652.736713:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634368 00000100:00100000:3.0:1790772652.736784:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1790772652.736794:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13833:x1877760796634368:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790772652.737055:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13833:x1877760796634368:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 260us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772652.737064:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1790772652.747132:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.748363:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634496 00000100:00100000:2.0:1790772652.748377:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634496 00000100:00100000:2.0:1790772652.748435:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:2.0:1790772652.748444:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13839:x1877760796634496:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772652.751138:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13839:x1877760796634496:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 2682us (4002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.751155:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1790772652.809497:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772652.809628:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634624 00000100:00100000:3.0:1790772652.809659:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634624 00000100:00100000:3.0:1790772652.809729:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:3.0:1790772652.809740:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13839:x1877760796634624:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772652.810062:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13839:x1877760796634624:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 322us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772652.810070:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:0.0:1790772652.854971:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.855190:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634752 00000100:00100000:2.0:1790772652.855202:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634752 00000100:00100000:2.0:1790772652.855256:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1790772652.855266:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13833:x1877760796634752:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772652.855282:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772652.855302:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328b974ca00/0xd3c7635991be28bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ca0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772652.855349:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328b974ca00/0xd3c7635991be28bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca0 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772652.855361:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328b974ca00/0xd3c7635991be28bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca0 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772652.855371:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974ca00, rc 0) 00000100:00100000:2.0:1790772652.855436:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13833:x1877760796634752:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 170us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.855443:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:0.0:1790772652.871128:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.871221:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796634880 00000100:00100000:2.0:1790772652.871232:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796634880 00000100:00100000:2.0:1790772652.871287:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:2.0:1790772652.871296:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b15fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13833:x1877760796634880:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790772652.871322:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790772652.871347:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790772652.871352:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790772652.871356:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790772652.871358:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00010000:00010000:1.0:1790772652.879491:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772652.880727:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b15fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13833:x1877760796634880:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 9423us (9602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.880741:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:0.0:1790772652.899740:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772652.900060:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635008 00000100:00100000:3.0:1790772652.900071:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635008 00000100:00100000:3.0:1790772652.900130:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:3.0:1790772652.900140:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13833:x1877760796635008:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772652.900157:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772652.900176:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ca7 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772652.900205:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772652.900218:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772652.900227:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9e00, rc 0) 00000100:00100000:3.0:1790772652.900290:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13833:x1877760796635008:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 151us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772652.900298:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:0.0:1790772652.906277:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.907358:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635136 00000100:00100000:2.0:1790772652.907371:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635136 00000100:00100000:2.0:1790772652.907435:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:2.0:1790772652.907446:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13833:x1877760796635136:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790772652.909193:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13833:x1877760796635136:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 1740us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.909208:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:0.0:1790772652.921400:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772652.921489:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635264 00000100:00100000:1.0:1790772652.921499:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635264 00000100:00100000:1.0:1790772652.921556:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:1.0:1790772652.921565:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13833:x1877760796635264:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790772652.921855:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13833:x1877760796635264:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 290us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772652.921863:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:0.0:1790772652.939188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772652.939617:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635392 00000100:00100000:2.0:1790772652.939638:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635392 00000100:00100000:2.0:1790772652.939696:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:2.0:1790772652.939706:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba5e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13843:x1877760796635392:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772652.940159:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba5e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13843:x1877760796635392:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 452us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772652.940168:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:3.0:1790772652.944828:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772652.944943:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635520 00000100:00100000:0.0:1790772652.945152:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635520 00000100:00100000:0.0:1790772652.945215:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1790772652.945227:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13843:x1877760796635520:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772652.947871:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13843:x1877760796635520:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 2635us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772652.947903:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:2.0:1790772652.971907:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772652.972253:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635648 00000100:00100000:0.0:1790772652.972264:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635648 00000100:00100000:0.0:1790772652.972315:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1790772652.972323:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1877760796635648:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790772652.972353:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ad5ec432-f248-4c90-9fe0-f28cd1c978c8@192.168.201.34@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1790772652.972398:0:14327:0:(genops.c:1384:class_connect()) connect: client ad5ec432-f248-4c90-9fe0-f28cd1c978c8, cookie 0xd3c7635991be28c9 00000004:00100000:0.0:1790772652.972432:0:14327:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790772652.972547:0:14327:0:(import.c:65:import_set_state_nolock()) ffff93288f0a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772652.973114:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2353:x1877760796635648:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 306us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772652.973125:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772653.006549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772653.006661:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635904 00000100:00100000:1.0:1790772653.006671:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635904 00000100:00100000:1.0:1790772653.006756:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1790772653.006767:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13833:x1877760796635904:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790772653.006798:0:14325:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790772653.006898:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13833:x1877760796635904:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772653.006906:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:2.0:1790772653.007945:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772653.039230:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772653.039472:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796635776 00000100:00100000:2.0:1790772653.039484:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796635776 00000100:00100000:2.0:1790772653.039542:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1790772653.039553:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:0:x1877760796635776:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790772653.039615:0:14326:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790772653.039704:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:0:x1877760796635776:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 152us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772653.039712:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1790772653.042973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772653.043069:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636032 00000100:00100000:0.0:1790772653.043079:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636032 00000100:00100000:0.0:1790772653.043139:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1790772653.043149:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13833:x1877760796636032:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790772653.043246:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13833:x1877760796636032:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772653.043270:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1790772653.055153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.055200:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.055231:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.055266:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.055294:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.055318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.055350:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636544 00000100:00100000:3.0:1790772653.055361:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636544 00000100:00100000:3.0:1790772653.055401:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636672 00000100:00100000:3.0:1790772653.055403:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636672 00000100:00100000:3.0:1790772653.055413:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636160 00000100:00100000:3.0:1790772653.055415:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636160 00000100:00100000:3.0:1790772653.055427:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1790772653.055435:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2356:x1877760796636544:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772653.055507:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2356:x1877760796636544:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772653.055516:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1790772653.055534:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1790772653.055541:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2356:x1877760796636672:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772653.055568:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2356:x1877760796636672:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772653.055574:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1790772653.055599:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772653.055603:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877760796636160:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790772653.055638:0:15010:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad5ec432-f248-4c90-9fe0-f28cd1c978c8@192.168.201.34@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1790772653.055684:0:15010:0:(genops.c:1384:class_connect()) connect: client ad5ec432-f248-4c90-9fe0-f28cd1c978c8, cookie 0xd3c7635991be28d0 00002000:00100000:3.0:1790772653.055696:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad5ec432-f248-4c90-9fe0-f28cd1c978c8/ffff9328bf5f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772653.055708:0:15010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772653.055822:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790772653.055863:0:15010:0:(import.c:65:import_set_state_nolock()) ffff93288f258000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772653.055925:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2353:x1877760796636160:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 320us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772653.055932:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772653.055972:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636928 00000100:00100000:3.0:1790772653.055977:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636928 00000100:00100000:3.0:1790772653.056000:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1790772653.056006:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13833:x1877760796636928:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790772653.056066:0:14329:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790772653.056112:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13833:x1877760796636928:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 106us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772653.056120:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1790772653.056318:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636416 00000100:00100000:2.0:1790772653.056324:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636416 00000100:00100000:2.0:1790772653.056363:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772653.056371:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2356:x1877760796636416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772653.056404:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2356:x1877760796636416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 34us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772653.056418:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1790772653.056496:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636288 00000100:00100000:0.0:1790772653.056501:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636288 00000100:00100000:0.0:1790772653.056536:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:0.0:1790772653.056544:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2356:x1877760796636288:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772653.056573:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2356:x1877760796636288:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772653.056579:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:3.0:1790772653.063743:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772653.063934:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796636800 00000100:00100000:1.0:1790772653.063947:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796636800 00000100:00100000:1.0:1790772653.064010:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1790772653.064034:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877760796636800:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790772653.064066:0:15010:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ad5ec432-f248-4c90-9fe0-f28cd1c978c8@192.168.201.34@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1790772653.064097:0:15010:0:(genops.c:1384:class_connect()) connect: client ad5ec432-f248-4c90-9fe0-f28cd1c978c8, cookie 0xd3c7635991be28d7 00002000:00100000:1.0:1790772653.064109:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad5ec432-f248-4c90-9fe0-f28cd1c978c8/ffff9328ba5ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790772653.064121:0:15010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790772653.064240:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790772653.064270:0:15010:0:(import.c:65:import_set_state_nolock()) ffff932891903800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772653.064340:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2353:x1877760796636800:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 306us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772653.064349:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1790772653.442802:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772653.442904:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637056 00000100:00100000:3.0:1790772653.442924:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637056 00000100:00100000:3.0:1790772653.442992:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1790772653.443002:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:13864:x1877760796637056:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:3.0:1790772653.443023:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772653.443046:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be28de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50cd1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772653.443114:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772653.443142:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772653.443156:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772653.443191:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772653.443195:0:14326:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772653.443217:0:14326:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772653.443242:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be28de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 8 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772653.443261:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772653.443270:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:3.0:1790772653.443272:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772653.443276:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8800, rc 0) 00000100:00100000:3.0:1790772653.443343:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+7:13864:x1877760796637056:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 343us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772653.443352:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772653.771210:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328bf62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813406336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772653.771289:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772653.771463:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406336 00000100:00100000:1.0:1790772653.771472:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406336 00000100:00080000:0.0:1790772653.771524:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772653.771541:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772653.771551:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813406336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772653.771590:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772653.771657:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813406336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772653.771664:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772653.772135:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328bf62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813406336:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1790772653.878910:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad5ec432-f248-4c90-9fe0-f28cd1c978c8 00000001:00100000:3.0:1790772653.878926:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2c98cc0-3117-4d23-8350-1bdc44edcae4 00010000:00010000:1.0:1790772653.899133:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772654.283390:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813406720:0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.283463:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772654.283531:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772654.283538:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813406848:0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.283578:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772654.283858:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813406592:0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.283916:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772654.283948:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813407104:0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.283974:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772654.283992:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790772654.283997:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813406464:0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.284025:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772654.284053:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813406976:0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.284073:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772654.284102:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406848 00000100:00100000:2.0:1790772654.284110:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406848 00000100:00100000:2.0:1790772654.284160:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407104 00000100:00100000:2.0:1790772654.284163:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407104 00000100:00100000:2.0:1790772654.284185:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406976 00000100:00100000:2.0:1790772654.284187:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406976 00000100:00100000:2.0:1790772654.284204:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772654.284212:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813406848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.284279:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1877760813406848:12345-0@lo:400:kworker.0 Request processed in 67us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772654.284286:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772654.284304:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772654.284310:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813407104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.284361:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813407104:12345-0@lo:400:kworker.0 Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772654.284367:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772654.284379:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772654.284385:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813406976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.284410:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813406976:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772654.284416:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772654.284451:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813406976:0@lo:400:kworker.0 00000100:00100000:2.0:1790772654.284462:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813407104:0@lo:400:kworker.0 00000100:00100000:1.0:1790772654.285059:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406720 00000100:00100000:1.0:1790772654.285065:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406720 00000100:00100000:1.0:1790772654.285107:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406592 00000100:00100000:1.0:1790772654.285111:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406592 00000100:00100000:1.0:1790772654.285135:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772654.285144:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813406720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772654.285188:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813406720:12345-0@lo:400:kworker.0 Request processed in 45us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772654.285204:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772654.285221:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772654.285227:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813406592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772654.285282:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813406592:12345-0@lo:400:kworker.0 Request processed in 54us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772654.285288:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772654.285323:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813406592:0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.285531:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813406464 00000100:00100000:0.0:1790772654.285536:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813406464 00000100:00100000:0.0:1790772654.285573:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790772654.285580:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3316:x1877760813406464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.285630:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3316:x1877760813406464:12345-0@lo:400:kworker.0 Request processed in 50us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772654.285637:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1790772654.285667:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772654.285672:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772654.285818:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1877760813406848:0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.285840:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790772654.285852:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813406720:0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.285896:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813406464:0@lo:400:kworker.0 00000100:00100000:0.0:1790772654.288472:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772654.288497:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813407232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772654.288578:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772654.292399:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407232 00000100:00100000:3.0:1790772654.292415:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407232 00000100:00100000:3.0:1790772654.292489:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772654.292516:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813407232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772654.292556:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772654.292661:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813407232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (4083us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772654.292669:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772654.302178:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813407232:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1790772654.378519:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad5ec432-f248-4c90-9fe0-f28cd1c978c8 00000001:00100000:2.0:1790772654.378539:0:7658:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2c98cc0-3117-4d23-8350-1bdc44edcae4 00000001:00100000:1.0:1790772654.824849:0:5878:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad5ec432-f248-4c90-9fe0-f28cd1c978c8 00000001:00100000:1.0:1790772654.825402:0:5878:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2c98cc0-3117-4d23-8350-1bdc44edcae4 00010000:00010000:0.0:1790772654.923380:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772655.948667:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772656.973411:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772657.402194:0:16296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790772657.995040:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772658.295014:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772658.295363:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637184 00000100:00100000:2.0:1790772658.295375:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637184 00000100:00100000:2.0:1790772658.295440:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:2.0:1790772658.295450:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2354:x1877760796637184:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772658.295545:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2354:x1877760796637184:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 96us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772658.295553:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:0.0:1790772658.303632:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772658.303790:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637312 00000100:00100000:2.0:1790772658.303800:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637312 00000100:00100000:2.0:1790772658.303923:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1790772658.303935:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2354:x1877760796637312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772658.304023:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2354:x1877760796637312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772658.304045:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00080000:0.0:1790772658.304463:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772658.311401:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772658.311450:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772658.311478:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772658.311530:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772658.311583:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772658.311584:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637568 00000100:00100000:3.0:1790772658.311601:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637568 00000100:00100000:1.0:1790772658.311647:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637696 00000100:00100000:1.0:1790772658.311657:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637696 00000100:00100000:3.0:1790772658.311691:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637824 00000100:00100000:3.0:1790772658.311698:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637824 00000100:00100000:1.0:1790772658.311723:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1790772658.311728:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637440 00000100:00100000:3.0:1790772658.311733:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637440 00000100:00100000:1.0:1790772658.311740:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2355:x1877760796637696:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772658.311753:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796637952 00000100:00100000:3.0:1790772658.311758:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796637952 00000100:00100000:3.0:1790772658.311782:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772658.311793:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796637568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772658.311843:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2355:x1877760796637696:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 107us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772658.311853:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1790772658.312192:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796637568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 398us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772658.312201:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772658.312224:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1790772658.312231:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796637824:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772658.312259:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796637824:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772658.312265:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1790772658.312277:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1790772658.312297:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796637440:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772658.312324:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796637440:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772658.312330:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1790772658.312342:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1790772658.312349:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796637952:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772658.312371:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796637952:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772658.312376:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00080000:0.0:1790772658.313097:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772658.313106:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772658.313109:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772658.896112:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772658.896133:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813407360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772658.896202:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772658.896271:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407360 00000100:00100000:1.0:1790772658.896280:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407360 00000100:00100000:1.0:1790772658.896325:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772658.896333:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813407360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772658.896383:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772658.896425:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813407360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772658.896431:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772658.896493:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813407360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772658.897569:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790772659.019811:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772659.403010:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813407616:0@lo:400:kworker.0 00000100:00100000:0.0:1790772659.403085:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772659.403144:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772659.403152:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813407488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772659.403180:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772659.403224:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407616 00000100:00100000:0.0:1790772659.403231:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407616 00000100:00100000:0.0:1790772659.403269:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790772659.403277:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3316:x1877760813407616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772659.403308:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407488 00000100:00100000:2.0:1790772659.403315:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407488 00000100:00100000:0.0:1790772659.403328:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3316:x1877760813407616:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772659.403353:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790772659.403358:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772659.403368:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813407488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772659.403412:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772659.403412:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d178e578-a8f2-4768-8767-0ddb2fe17697:3316:1877760813407616:0@lo:400:kworker.0 00000100:00100000:2.0:1790772659.403487:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813407488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772659.403493:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790772659.403514:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772659.403575:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813407488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772659.415242:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813407872:0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.415314:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772659.415341:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407872 00000100:00100000:2.0:1790772659.415349:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407872 00000100:00100000:3.0:1790772659.415353:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772659.415359:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813407744:0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.415384:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772659.415392:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772659.415408:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813408128:0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.415431:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772659.415450:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772659.415455:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813408000:0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.415495:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772659.415517:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813407744 00000100:00100000:3.0:1790772659.415521:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813407744 00000100:00100000:3.0:1790772659.415551:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772659.415559:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813407744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.415612:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813407744:12345-0@lo:400:kworker.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772659.415628:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772659.415651:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813408128 00000100:00100000:3.0:1790772659.415654:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813408128 00000100:00100000:1.0:1790772659.415900:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813408000 00000100:00100000:1.0:1790772659.415905:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813408000 00000100:00100000:2.0:1790772659.415986:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813407872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772659.416025:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813407872:12345-0@lo:400:kworker.0 Request processed in 42us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772659.422771:0:14325:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790772659.422791:0:14325:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790772659.424033:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790772659.424055:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813408128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.424166:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1877760813408128:12345-0@lo:400:kworker.0 Request processed in 121us (8732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772659.424174:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790772659.424214:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772659.424258:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1877760813408128:0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.424299:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813407744:0@lo:400:kworker.0 00000100:00100000:3.0:1790772659.424309:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813407872:0@lo:400:kworker.0 00000100:00100000:0.0:1790772659.439720:0:14326:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790772659.439746:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772659.439762:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813408000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772659.439856:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1877760813408000:12345-0@lo:400:kworker.0 Request processed in 100us (24359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772659.439863:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772659.439945:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772659.440141:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1877760813408000:0@lo:400:kworker.0 00010000:00010000:3.0:1790772660.043103:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772660.299524:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772661.066979:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772662.092977:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790772662.505202:0:16445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6864b2f0 20000000:00000080:2.0:1790772662.505221:0:16445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff932887927400 uarg=0000000000000000 20000000:01000000:2.0:1790772662.505260:0:16445:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790772662.505265:0:16445:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790772662.505270:0:16445:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790772662.506844:0:16446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790772662.509713:0:16445:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790772662.518982:0:16445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790772662.519112:0:16445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519133:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be25dc expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519141:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2629 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519148:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2764 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519175:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519182:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519191:0:16445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519235:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519252:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 12 pid: 14317 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.519267:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408256:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772662.519380:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519388:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 12 pid: 14320 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.519397:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408384:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772662.519447:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be2764 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519455:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be2764 expref: 18 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.519485:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408512:0@lo:104: 00000100:00100000:3.0:1790772662.519528:0:16445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772662.519573:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be2629 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519580:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be2629 expref: 18 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.519588:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1182300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408640:0@lo:104: 00000100:00100000:3.0:1790772662.519610:0:16445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772662.519635:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3c7635991be25dc expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.519655:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3c7635991be25dc expref: 18 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.519664:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408768:0@lo:104: 00000100:00100000:3.0:1790772662.519688:0:16445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772662.519699:0:16445:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f1c1780 going to sleep for 11 seconds 00000100:00100000:0.0:1790772662.520089:0:14309:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790772662.520103:0:14309:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813408512 00000100:00100000:0.0:1790772662.520111:0:14309:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813408512 00000100:00100000:0.0:1790772662.520147:0:14309:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813408640 00000100:00100000:0.0:1790772662.520151:0:14309:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813408640 00000100:00100000:0.0:1790772662.520160:0:14309:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813408768 00000100:00100000:0.0:1790772662.520162:0:14309:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813408768 00000100:00100000:0.0:1790772662.520175:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772662.520182:0:14309:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+5:16445:x1877760813408512:12345-0@lo:104: 00010000:00010000:0.0:1790772662.520194:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520247:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772662.520253:0:14309:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+5:16445:x1877760813408512:12345-0@lo:104: Request processed in 72us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772662.520260:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772662.520285:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772662.520291:0:14309:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+4:16445:x1877760813408640:12345-0@lo:104: 00010000:00010000:0.0:1790772662.520298:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520332:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790772662.520337:0:14309:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+4:16445:x1877760813408640:12345-0@lo:104: Request processed in 47us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772662.520342:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772662.520354:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772662.520360:0:14309:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+3:16445:x1877760813408768:12345-0@lo:104: 00010000:00010000:0.0:1790772662.520368:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520397:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790772662.520402:0:14309:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d178e578-a8f2-4768-8767-0ddb2fe17697+3:16445:x1877760813408768:12345-0@lo:104: Request processed in 43us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772662.520407:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790772662.520474:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790772662.520480:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520488:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4daa00 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772662.520492:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520501:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772662.520520:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772662.520526:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772662.520555:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520561:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772662.520584:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520592:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328ba4daa00/0xd3c7635991be2764 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be276b expref: -99 pid: 15731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520605:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772662.520608:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520613:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9800 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772662.520616:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520622:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772662.520628:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772662.520633:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772662.520822:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520829:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772662.520836:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520842:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328bf5e9800/0xd3c7635991be2629 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be2630 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520852:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772662.520854:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520859:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c000 already unused, calling callback (ffffffffc1b4ec20) 10000000:00010000:0.0:1790772662.520862:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520868:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772662.520900:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772662.520905:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772662.520917:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520922:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772662.520936:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520951:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff9328b974c000/0xd3c7635991be25dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3c7635991be25e3 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.520965:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772662.520967:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772662.520969:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772662.520976:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772662.520988:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813409024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772662.521022:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772662.521056:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772662.521062:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813408896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772662.521084:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772662.521106:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d178e578-a8f2-4768-8767-0ddb2fe17697:3315:1877760813409152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772662.521126:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772662.521153:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409024 00000100:00100000:0.0:1790772662.521158:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409024 00010000:00010000:0.0:1790772662.521178:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2629 expref: 19 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772662.521192:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813408896 00000100:00100000:0.0:1790772662.521194:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813408896 00010000:00010000:0.0:1790772662.521204:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2764 expref: 20 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772662.521213:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409152 00000100:00100000:0.0:1790772662.521216:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409152 00010000:00010000:0.0:1790772662.521225:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be25dc expref: 21 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772662.521250:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772662.521257:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+21:3318:x1877760813409024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772662.521268:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772662.521273:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2629 expref: 21 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.521281:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be2629 expref: 21 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.521296:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772662.521324:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+21:3318:x1877760813409024:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772662.521330:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772662.521344:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772662.521350:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+20:3318:x1877760813408896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772662.521357:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772662.521361:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be2764 expref: 20 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.521368:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be2764 expref: 20 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.521377:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772662.521398:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+20:3318:x1877760813408896:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772662.521403:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772662.521416:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772662.521451:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba605c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3315:x1877760813409152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772662.521459:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772662.522079:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328b974d800/0xd3c7635991be276b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be2764 expref: 19 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.522093:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408512:0@lo:104: 00010000:00010000:3.0:1790772662.522103:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e8200/0xd3c7635991be2630 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be2629 expref: 18 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772662.522110:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1182300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408640:0@lo:104: 00000100:00100000:3.0:1790772662.522117:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408768:0@lo:104: 00010000:00010000:0.0:1790772662.522287:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3c7635991be25dc expref: 17 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.522298:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3c7635991be25dc expref: 17 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.522310:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9a00/0xd3c7635991be25e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3c7635991be25dc expref: 17 pid: 14319 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772662.522321:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772662.522452:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba605c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d178e578-a8f2-4768-8767-0ddb2fe17697+16:3315:x1877760813409152:12345-0@lo:103:ldlm_bl.0 Request processed in 1001us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772662.522460:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772662.522525:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813408896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772662.522534:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813409024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772662.522743:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772662.527560:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772662.527637:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772662.527908:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408256:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772662.527922:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1877760813408384:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772662.527957:0:16445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772662.529452:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638080 00000100:00100000:2.0:1790772662.529729:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d178e578-a8f2-4768-8767-0ddb2fe17697:3315:1877760813409152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772662.530195:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638080 00010000:00010000:2.0:1790772662.530291:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 13 pid: 14317 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772662.530338:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638208 00000100:00100000:2.0:1790772662.530342:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638208 00010000:00010000:2.0:1790772662.530359:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 14 pid: 14320 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772662.530375:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1790772662.530384:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e31b6460-4591-4d63-a470-ddffcd27dc7d+14:2355:x1877760796638080:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772662.530399:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772662.530405:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 14 pid: 14317 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530416:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 14 pid: 14317 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530451:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9e00/0xd3c7635991be28c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ca7 expref: 14 pid: 14317 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530567:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772662.530677:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2355:x1877760796638080:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 293us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772662.530686:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1790772662.530705:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1790772662.530712:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:2355:x1877760796638208:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772662.530720:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772662.530725:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 12 pid: 14320 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530745:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 12 pid: 14320 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530757:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328b974d600/0xd3c7635991be288a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c45 expref: 12 pid: 14320 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530770:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530779:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530794:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530802:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530811:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530819:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530827:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9c00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772662.530831:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530840:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530866:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772662.530902:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772662.530923:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:2355:x1877760796638208:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 211us (3286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772662.530929:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:3.0:1790772662.532377:0:16445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.532393:0:16445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772662.532400:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9328bf5e9c00/0xd3c7635991be28ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772663.116386:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772663.407353:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772663.407414:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772663.407527:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638464 00000100:00100000:0.0:1790772663.407539:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638464 00000100:00100000:0.0:1790772663.407612:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1790772663.407622:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2357:x1877760796638464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772663.407705:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2357:x1877760796638464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772663.407713:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00080000:3.0:1790772663.408341:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772663.410756:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772663.410826:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772663.410858:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772663.410921:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772663.410945:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772663.410972:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638848 00000100:00100000:0.0:1790772663.410981:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638848 00000100:00100000:0.0:1790772663.411036:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1790772663.411047:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2356:x1877760796638848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772663.411118:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2356:x1877760796638848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772663.411126:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1790772663.411274:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638592 00000100:00100000:3.0:1790772663.411278:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638592 00000100:00100000:3.0:1790772663.411300:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638720 00000100:00100000:3.0:1790772663.411303:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638720 00000100:00100000:3.0:1790772663.411314:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638976 00000100:00100000:3.0:1790772663.411316:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638976 00000100:00100000:3.0:1790772663.411326:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639104 00000100:00100000:3.0:1790772663.411328:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639104 00000100:00100000:3.0:1790772663.411341:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772663.411348:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2356:x1877760796638592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772663.411375:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2356:x1877760796638592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772663.411381:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1790772663.411414:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1790772663.411422:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2357:x1877760796638720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772663.411445:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2357:x1877760796638720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772663.411461:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1790772663.411473:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1790772663.411479:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2357:x1877760796638976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772663.411502:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2357:x1877760796638976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772663.411508:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1790772663.411520:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1790772663.411526:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2356:x1877760796639104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772663.411547:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2356:x1877760796639104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772663.411553:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00080000:3.0:1790772663.411686:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772663.411690:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772663.411693:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772663.413952:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796638336 00000100:00100000:2.0:1790772663.413965:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796638336 00000100:00100000:2.0:1790772663.414013:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:2.0:1790772663.414022:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:2356:x1877760796638336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772663.414096:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:2356:x1877760796638336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 74us (6681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772663.414103:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:0.0:1790772664.013111:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813409280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772664.013200:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772664.013420:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409280 00000100:00100000:2.0:1790772664.013429:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409280 00000100:00100000:2.0:1790772664.013495:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772664.013505:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813409280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772664.013536:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772664.013577:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813409280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772664.013584:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790772664.013604:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772664.013926:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813409280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790772664.153166:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772664.370567:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772664.370624:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639232 00000100:00100000:0.0:1790772664.370982:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639232 00000100:00100000:0.0:1790772664.371043:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:0.0:1790772664.371054:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+11:13719:x1877760796639232:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772664.371072:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772664.371092:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328c12be000/0xd3c7635991be28f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50cd8 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.371122:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328c12be000/0xd3c7635991be28f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd8 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.371133:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328c12be000/0xd3c7635991be28f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd8 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.373408:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be000, rc 0) 00000100:00100000:0.0:1790772664.373491:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13719:x1877760796639232:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 2436us (2931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772664.373500:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:1.0:1790772664.381236:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772664.390504:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639360 00000100:00100000:2.0:1790772664.390520:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639360 00000100:00100000:2.0:1790772664.390650:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:2.0:1790772664.390661:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13719:x1877760796639360:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772664.391006:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13719:x1877760796639360:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 346us (9778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772664.391015:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:1.0:1790772664.400891:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772664.401988:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639488 00000100:00100000:1.0:1790772664.402001:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639488 00000100:00100000:3.0:1790772664.413915:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:3.0:1790772664.413943:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13719:x1877760796639488:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.415989:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13719:x1877760796639488:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 2049us (15111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.416003:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:3.0:1790772664.430440:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772664.434857:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639616 00000100:00100000:1.0:1790772664.434928:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639616 00000100:00100000:1.0:1790772664.434994:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:1.0:1790772664.435002:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+12:13719:x1877760796639616:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772664.435020:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772664.435049:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da200/0xd3c7635991be28fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50cdf expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.435082:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da200/0xd3c7635991be28fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cdf expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.435094:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da200/0xd3c7635991be28fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cdf expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.435104:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da200, rc 0) 00000100:00100000:1.0:1790772664.435170:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13719:x1877760796639616:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 168us (4745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772664.435177:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:1.0:1790772664.440127:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772664.440239:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639744 00000100:00100000:3.0:1790772664.440251:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639744 00000100:00100000:3.0:1790772664.440297:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:3.0:1790772664.440306:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13719:x1877760796639744:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.440611:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13719:x1877760796639744:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 305us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.440619:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:1.0:1790772664.451603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772664.453079:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796639872 00000100:00100000:3.0:1790772664.453095:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796639872 00000100:00100000:3.0:1790772664.453153:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1790772664.453163:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13719:x1877760796639872:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.453404:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:13719:x1877760796639872:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 241us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.453412:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 10000000:01000000:1.0:1790772664.464457:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772664.464466:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff932891907000 from 10 10000000:01000000:1.0:1790772664.464471:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772664.464517:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.464530:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.464542:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772664.464569:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772664.464633:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772664.464677:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886c68780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772664.464706:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409408 00000100:00100000:1.0:1790772664.464714:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409408 00000100:00100000:1.0:1790772664.464771:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790772664.464781:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+16:14322:x1877760813409408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772664.464793:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772664.464804:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4da000/0xd3c7635991be2908 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be2901 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.464826:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4da000/0xd3c7635991be2908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be2901 expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.464836:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4da000/0xd3c7635991be2908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be2901 expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.464845:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4da000, rc 0) 00000100:00100000:1.0:1790772664.464900:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:14322:x1877760813409408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772664.464907:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790772664.464947:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772664.464960:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2908 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.464969:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2908 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772664.465014:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772664.465038:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772664.465051:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772664.467667:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409536 00000100:00100000:3.0:1790772664.467681:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409536 00000100:00100000:3.0:1790772664.467737:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790772664.467745:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+17:14322:x1877760813409536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.468035:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+17:14322:x1877760813409536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.468043:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790772664.468101:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.468153:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.468194:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.468219:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f39a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772664.468230:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409664 00000100:00100000:3.0:1790772664.468233:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409664 00000100:00100000:3.0:1790772664.468251:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790772664.468257:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+17:14322:x1877760813409664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.468378:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9b92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+17:14322:x1877760813409664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.468398:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790772664.468434:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790772664.479234:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790772664.480322:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790772664.480350:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772664.480361:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2908 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.480374:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328ba4da800/0xd3c7635991be2901 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2908 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772664.480396:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772664.480400:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9328b9432800 from 10 10000000:01000000:0.0:1790772664.480403:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772664.481739:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.481816:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.481831:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772664.481860:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.482371:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772664.482420:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772664.491801:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409792 00000100:00100000:1.0:1790772664.491816:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409792 00000100:00100000:1.0:1790772664.491941:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790772664.491953:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+17:14322:x1877760813409792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772664.491971:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772664.491988:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4db000/0xd3c7635991be2916 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be290f expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.492013:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4db000/0xd3c7635991be2916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be290f expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.492025:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4db000/0xd3c7635991be2916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be290f expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.492034:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db000, rc 0) 00000100:00100000:1.0:1790772664.492111:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813409792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (9741us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772664.492118:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790772664.492345:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772664.492374:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2916 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772664.492396:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2916 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772664.492845:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.492915:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772664.492953:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772664.494551:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813409920 00000100:00100000:1.0:1790772664.494561:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813409920 00000100:00100000:1.0:1790772664.494604:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790772664.494621:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813409920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772664.495062:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813409920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772664.495070:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790772664.496336:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813409920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.496403:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.498452:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772664.498500:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328bf68e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772664.498523:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410048 00000100:00100000:0.0:1790772664.498530:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410048 00000100:00100000:0.0:1790772664.498574:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790772664.498581:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813410048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.499375:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813410048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 790us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772664.499599:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.500104:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000040:00080000:1.0:1790772664.505829:0:16511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790772664.505941:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790772664.505963:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772664.505974:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2916 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.505986:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328c12bf000/0xd3c7635991be290f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2916 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772664.505996:0:14322:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772664.505998:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93288694b000 from 10 10000000:01000000:1.0:1790772664.506001:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772664.506038:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.506046:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.506057:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772664.506083:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772664.506151:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772664.506185:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886c680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772664.506204:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410176 00000100:00100000:1.0:1790772664.506210:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410176 00000100:00100000:1.0:1790772664.506251:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790772664.506259:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+18:14322:x1877760813410176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772664.506272:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772664.506284:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9328ba4dac00/0xd3c7635991be2924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3c7635991be291d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.506317:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9328ba4dac00/0xd3c7635991be2924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3c7635991be291d expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.506327:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9328ba4dac00/0xd3c7635991be2924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3c7635991be291d expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.506336:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dac00, rc 0) 00000100:00100000:1.0:1790772664.506374:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813410176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772664.506381:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790772664.506438:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772664.506451:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2924 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772664.506460:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3c7635991be2924 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772664.506505:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772664.506530:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772664.506543:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886c680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772664.508572:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410304 00000100:00100000:0.0:1790772664.508585:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410304 00000100:00100000:0.0:1790772664.508629:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790772664.508848:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813410304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.509167:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813410304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772664.509184:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790772664.509249:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f0cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.509295:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.509339:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772664.509367:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a04b79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772664.509381:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410432 00000100:00100000:0.0:1790772664.511527:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410432 00000100:00100000:0.0:1790772664.511588:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790772664.511597:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813410432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772664.512061:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d178e578-a8f2-4768-8767-0ddb2fe17697+19:14322:x1877760813410432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 463us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772664.512070:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790772664.512141:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d178e578-a8f2-4768-8767-0ddb2fe17697:14322:1877760813410432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772664.523901:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813410560:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.523973:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.524007:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813411072:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.524033:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.524059:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772664.524064:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813410688:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.524087:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.524117:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813410816:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.524140:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.524159:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772664.524164:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813410944:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.524184:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.524215:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410560 00000100:00100000:3.0:1790772664.524223:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410560 00000100:00100000:3.0:1790772664.524264:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410688 00000100:00100000:3.0:1790772664.524267:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410688 00000100:00100000:3.0:1790772664.524294:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772664.524302:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813410560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.524364:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813410560:12345-0@lo:400:kworker.0 Request processed in 62us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.524372:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:1.0:1790772664.526919:0:16513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:3.0:1790772664.527301:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772664.527319:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813410688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.527411:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1877760813410688:12345-0@lo:400:kworker.0 Request processed in 99us (3322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.527419:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:2.0:1790772664.527540:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790772664.527562:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772664.527574:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2924 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772664.527585:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff9328ba4db200/0xd3c7635991be291d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3c7635991be2924 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772664.527823:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813411072 00000100:00100000:3.0:1790772664.527831:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813411072 00000100:00100000:3.0:1790772664.527900:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410816 00000100:00100000:3.0:1790772664.527905:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410816 00000100:00100000:3.0:1790772664.527920:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813410944 00000100:00100000:3.0:1790772664.527922:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813410944 00000100:00100000:3.0:1790772664.527936:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790772664.527942:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813411072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.527981:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1877760813411072:12345-0@lo:400:kworker.0 Request processed in 39us (3947us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.527988:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790772664.528001:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772664.528006:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813410816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.528039:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813410816:12345-0@lo:400:kworker.0 Request processed in 33us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.528045:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772664.528057:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772664.528063:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813410944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.528111:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813410944:12345-0@lo:400:kworker.0 Request processed in 49us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.528117:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1790772664.528149:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772664.528154:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772664.528187:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813411200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772664.528225:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772664.528262:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813411200 00000100:00100000:3.0:1790772664.528266:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813411200 00000100:00100000:3.0:1790772664.528290:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772664.528296:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813411200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772664.528321:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772664.528356:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813411200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772664.528362:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772664.528413:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c0f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813411200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772664.534986:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813410688:0@lo:400:kworker.0 00000100:00100000:1.0:1790772664.535004:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1877760813410560:0@lo:400:kworker.0 00000100:00100000:1.0:1790772664.535016:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1877760813411072:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.536502:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813410944:0@lo:400:kworker.0 00000100:00100000:3.0:1790772664.536518:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813410816:0@lo:400:kworker.0 00010000:00010000:2.0:1790772665.164721:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772666.189385:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772666.810086:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772666.813790:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796640000 00000100:00100000:0.0:1790772666.813815:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796640000 00000100:00100000:0.0:1790772666.814109:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1790772666.814126:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:14375:x1877760796640000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772666.814157:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772666.814188:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be292b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ce6 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.814280:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.814299:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.814332:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.814399:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.814408:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.814416:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.815629:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be2940 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.815649:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be2940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.815764:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be2940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772666.815803:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772666.815807:0:14326:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772666.815853:0:14326:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be2940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.815866:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816086:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816108:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816115:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772666.816120:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816129:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816143:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:0.0:1790772666.816146:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772666.816152:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816158:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf600/0xd3c7635991be2932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816173:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816178:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816183:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816187:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772666.816189:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816202:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816209:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff932899c35f00) 00010000:00010000:0.0:1790772666.816211:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772666.816214:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816221:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be2939 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816271:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be292b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ce6 expref: 8 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816286:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfa00/0xd3c7635991be2940 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ce6 expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.816293:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff932899c35600) 00010000:00010000:0.0:1790772666.816296:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772666.816298:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bfa00, rc 0) 00000100:00100000:0.0:1790772666.816635:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:14375:x1877760796640000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2514us (6764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772666.816645:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:3.0:1790772666.820870:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772666.827258:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772666.828456:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796640256 00000100:00100000:0.0:1790772666.828477:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796640256 00000100:00100000:0.0:1790772666.828566:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1790772666.828577:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:14375:x1877760796640256:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772666.828627:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772666.828654:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2947 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50ced expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.828763:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.828782:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.828796:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.830412:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.830438:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.830451:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831261:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bee00/0xd3c7635991be295c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831274:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bee00/0xd3c7635991be295c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831284:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bee00/0xd3c7635991be295c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772666.831296:0:14325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790772666.831534:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831542:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831549:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831555:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772666.831559:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831566:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831578:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff932899c35600) 00010000:00010000:0.0:1790772666.831581:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772666.831586:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831591:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be294e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831604:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831610:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831616:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831630:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772666.831633:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831639:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831647:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff932899c35500) 00010000:00010000:0.0:1790772666.831649:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772666.831652:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.831658:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2955 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.842696:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2947 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ced expref: 10 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.842727:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bee00/0xd3c7635991be295c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50ced expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.842738:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff932899c35e00) 00010000:00010000:0.0:1790772666.842741:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772666.842744:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bee00, rc 0) 00000100:00100000:0.0:1790772666.842823:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14375:x1877760796640256:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 14246us (15578us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790772666.842831:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1790772666.850367:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772666.850853:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796640384 00000100:00100000:3.0:1790772666.850868:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796640384 00000100:00100000:0.0:1790772666.851068:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772666.851574:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14375:x1877760796640384:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790772666.851983:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14375:x1877760796640384:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 606us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772666.851994:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772666.866139:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772666.868788:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796640512 00000100:00100000:2.0:1790772666.868810:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796640512 00000100:00100000:2.0:1790772666.869067:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1790772666.869082:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14381:x1877760796640512:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772666.869113:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772666.869142:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be296a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50cf4 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869240:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869260:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869276:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869315:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869324:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869332:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869825:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869837:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869845:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869852:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772666.869858:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.869867:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870141:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:2.0:1790772666.870145:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772666.870152:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870160:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870185:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870192:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870199:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870204:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772666.870208:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870215:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870224:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9328a1803e00) 00010000:00010000:2.0:1790772666.870294:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772666.870298:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870305:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870362:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be296a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cf4 expref: 10 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870375:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:2.0:1790772666.870377:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772666.870495:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be296a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cf4 expref: 10 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.870570:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974c000, rc 0) 00000100:00100000:2.0:1790772666.870668:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14381:x1877760796640512:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1590us (4540us total) trans 0 rc 301/301 00000100:00100000:2.0:1790772666.870678:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1790772666.875034:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772666.875286:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796640640 00000100:00100000:0.0:1790772666.875299:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796640640 00000100:00100000:0.0:1790772666.875372:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1790772666.875385:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14381:x1877760796640640:12345-192.168.201.34@tcp:700:lfs.0 00000100:00100000:0.0:1790772666.875750:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14381:x1877760796640640:12345-192.168.201.34@tcp:700:lfs.0 Request processed in 367us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772666.875760:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1790772666.878182:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772666.878318:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796640896 00000100:00100000:2.0:1790772666.878329:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796640896 00000100:00100000:2.0:1790772666.878472:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1790772666.878485:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f0cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14381:x1877760796640896:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:2.0:1790772666.878566:0:16345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772666.878600:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be28ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50c6f expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.878624:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:2.0:1790772666.878630:0:16345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772666.878994:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.879012:0:16345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 5 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.879021:0:16345:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.879064:0:16345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 5 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.879093:0:16345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 5 pid: 14326 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772666.879111:0:16345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1193800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1877760813411328:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772666.879238:0:16345:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328c0f85b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772666.882441:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772666.882441:0:16345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1193800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1877760813411328:192.168.201.34@tcp:104: 00010000:00010000:1.0:1790772666.882485:0:16345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772666.882844:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796641024 00000100:00100000:0.0:1790772666.882855:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796641024 00010000:00010000:0.0:1790772666.882950:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 6 pid: 14326 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772666.882994:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1790772666.883005:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2356:x1877760796641024:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772666.883027:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772666.883035:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 6 pid: 14326 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.883047:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 6 pid: 14326 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.883073:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be28e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cd1 expref: 6 pid: 14326 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.883091:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:0.0:1790772666.883098:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.883143:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.883153:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.883184:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772666.883251:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2356:x1877760796641024:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 248us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772666.883260:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00010000:00010000:1.0:1790772666.883464:0:16345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.883473:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.883649:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.883661:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.883671:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790772666.883858:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1790772666.886425:0:16345:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790772666.886448:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.886461:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.886470:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.886477:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772666.886491:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.887639:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.887668:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803100) 00010000:00010000:1.0:1790772666.887672:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772666.887678:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772666.887686:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be297f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772666.887773:0:16345:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008b9ed90b reply state 00000000bcd8ada1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772666.887785:0:16345:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772666.887951:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f0cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14381:x1877760796640896:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 9463us (9774us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790772666.887961:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00010000:00010000:0.0:1790772666.893353:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.893383:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.893393:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.893410:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4daa00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772666.893417:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.893427:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.893447:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9328a16c3200) 00010000:00010000:0.0:1790772666.893450:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772666.893456:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772666.893488:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4daa00/0xd3c7635991be2986 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772666.995017:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772666.995117:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796641152 00000100:00100000:2.0:1790772666.995131:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796641152 00000100:00100000:2.0:1790772666.995221:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1790772666.995490:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:14389:x1877760796641152:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:2.0:1790772666.995536:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772666.995569:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be298d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50cfb expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.995659:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be2994 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.995677:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.995690:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772666.995745:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772666.995749:0:14327:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772666.995799:0:14327:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.995985:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be298d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cfb expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.996006:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c000/0xd3c7635991be2994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50cfb expref: 10 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772666.996017:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772666.996020:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772666.996024:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974c000, rc 0) 00000100:00100000:2.0:1790772666.996102:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14389:x1877760796641152:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 617us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772666.999901:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1790772667.023155:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.023253:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796641280 00000100:00100000:3.0:1790772667.023266:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796641280 00000100:00100000:3.0:1790772667.023329:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1790772667.023337:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:14391:x1877760796641280:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772667.023376:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772667.023413:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be299b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d02 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.023612:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be29a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.023632:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.023646:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772667.023692:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772667.023697:0:14326:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772667.023726:0:14326:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.023757:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be299b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d02 expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.023803:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8200/0xd3c7635991be29a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d02 expref: 6 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.023812:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:3.0:1790772667.023815:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772667.023820:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8200, rc 0) 00000100:00100000:3.0:1790772667.024152:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:14391:x1877760796641280:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 814us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772667.024162:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1790772667.027605:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772667.027692:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796641408 00000100:00100000:0.0:1790772667.027768:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796641408 00000100:00100000:0.0:1790772667.027856:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772667.027869:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:14391:x1877760796641408:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772667.028167:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772667.028198:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be29a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d09 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.028288:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.028309:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.028322:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.028350:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.028358:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.028365:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.035358:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be29be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.035399:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be29be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.035412:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be29be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772667.035993:0:14325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772667.035999:0:14325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772667.036031:0:14325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be29be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036048:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036055:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036061:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036067:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12be200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772667.036072:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036079:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036091:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772667.036094:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772667.036099:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036120:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be200/0xd3c7635991be29b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036261:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036269:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036280:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036286:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfe00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772667.036289:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036295:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036303:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff932899c35500) 00010000:00010000:0.0:1790772667.036307:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772667.036310:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036316:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be29b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036371:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be29a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d09 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036400:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be29be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d09 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.036407:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932899c35f00) 00010000:00010000:0.0:1790772667.036409:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772667.036412:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be600, rc 0) 00000100:00100000:0.0:1790772667.036501:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+7:14391:x1877760796641408:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 8635us (9007us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772667.036509:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772667.043782:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.043984:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796641664 00000100:00100000:3.0:1790772667.043999:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796641664 00000100:00100000:3.0:1790772667.044076:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:3.0:1790772667.044087:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+7:14391:x1877760796641664:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772667.044118:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772667.044147:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d10 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772667.044267:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790772667.044442:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d10 expref: 9 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.044461:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:3.0:1790772667.044465:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772667.044471:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d10 expref: 9 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.044521:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8e00, rc 0) 00000100:00100000:3.0:1790772667.044616:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+8:14391:x1877760796641664:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 529us (849us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790772667.044625:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1790772667.053070:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.053292:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796641920 00000100:00100000:3.0:1790772667.053308:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796641920 00000100:00100000:3.0:1790772667.053397:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1790772667.053410:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+8:14391:x1877760796641920:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1790772667.053493:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772667.053537:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be600/0xd3c7635991be29be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d09 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.053564:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932899c35f00) 00010000:00010000:3.0:1790772667.053578:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772667.053609:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.053625:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.053637:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772667.054136:0:14327:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007c2a7cbc reply state 000000006924640b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772667.054149:0:14327:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790772667.054179:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790772667.054294:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+9:14391:x1877760796641920:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 885us (1239us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790772667.054302:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00010000:00010000:1.0:1790772667.056555:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.056575:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.056583:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.056590:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772667.056614:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.056623:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.056642:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8db00) 00010000:00010000:1.0:1790772667.056646:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790772667.056652:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.056660:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be29d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772667.061406:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.061558:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796642176 00000100:00100000:1.0:1790772667.061572:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796642176 00000100:00100000:1.0:1790772667.061649:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1790772667.061662:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+8:14391:x1877760796642176:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772667.062282:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+9:14391:x1877760796642176:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 622us (888us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790772667.062292:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1790772667.066064:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.066207:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796642432 00000100:00100000:3.0:1790772667.066219:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796642432 00000100:00100000:3.0:1790772667.066297:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1790772667.066310:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+9:14391:x1877760796642432:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772667.066359:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772667.066397:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d17 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.066499:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.066624:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.066639:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.066660:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.066669:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.066677:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772667.067045:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790772667.067187:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067197:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067205:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067212:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9e00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772667.067217:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067226:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067243:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:3.0:1790772667.067247:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772667.067253:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067260:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be29e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067276:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067283:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067289:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067305:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9a00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772667.067309:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067316:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067325:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff932884a8de00) 00010000:00010000:3.0:1790772667.067328:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772667.067331:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067348:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067600:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d17 expref: 11 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067613:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:3.0:1790772667.067616:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772667.067620:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d17 expref: 11 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.067632:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8e00, rc 0) 00000100:00100000:3.0:1790772667.067990:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+10:14391:x1877760796642432:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1682us (1939us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1790772667.068001:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1790772667.076242:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.076371:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796642560 00000100:00100000:3.0:1790772667.076424:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796642560 00000100:00100000:3.0:1790772667.076658:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1790772667.076672:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+10:14391:x1877760796642560:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772667.076720:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772667.076752:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d1e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.077015:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.077033:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.077047:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772667.077085:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772667.077090:0:14327:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772667.077113:0:14327:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.077144:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be29f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 12 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.077167:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.077176:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:3.0:1790772667.077179:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772667.077182:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9a00, rc 0) 00000100:00100000:3.0:1790772667.077269:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:14391:x1877760796642560:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 601us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772667.077277:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1790772667.081403:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.082608:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796642688 00000100:00100000:3.0:1790772667.082624:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796642688 00000100:00100000:3.0:1790772667.082700:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1790772667.083057:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:14391:x1877760796642688:12345-192.168.201.34@tcp:37:lfs.0 00000100:00100000:2.0:1790772667.090790:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:14391:x1877760796642688:12345-192.168.201.34@tcp:37:lfs.0 Request processed in 7754us (9386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772667.090814:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1790772667.096492:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.096651:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796642944 00000100:00100000:1.0:1790772667.096665:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796642944 00000100:00100000:1.0:1790772667.096740:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1790772667.096752:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f043050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:14391:x1877760796642944:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1790772667.097689:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f043050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+12:14391:x1877760796642944:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 932us (1205us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790772667.097702:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00010000:00010000:2.0:1790772667.212237:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772667.213815:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.220462:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796643072 00000100:00100000:1.0:1790772667.220488:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796643072 00000100:00100000:1.0:1790772667.220597:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1790772667.220611:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14397:x1877760796643072:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772667.220667:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772667.220698:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d25 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.220826:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.220847:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.220860:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.220919:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.220927:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.220944:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221079:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbe00/0xd3c7635991be2a19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221088:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbe00/0xd3c7635991be2a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221096:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbe00/0xd3c7635991be2a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772667.221131:0:16345:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790772667.221143:0:16345:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772667.221197:0:16345:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbe00/0xd3c7635991be2a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221213:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221233:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221243:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221250:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772667.221255:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221265:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221279:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772667.221283:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772667.221289:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221296:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221314:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221320:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221348:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221354:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4db800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772667.221357:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221364:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221373:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9328a16c3100) 00010000:00010000:1.0:1790772667.221379:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772667.221383:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221389:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221429:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d25 expref: 12 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221445:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbe00/0xd3c7635991be2a19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d25 expref: 11 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.221454:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:1.0:1790772667.221456:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790772667.221459:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4dbe00, rc 0) 00000100:00100000:1.0:1790772667.221554:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+11:14397:x1877760796643072:12345-192.168.201.34@tcp:101:bash.0 Request processed in 945us (7863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772667.221571:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1790772667.227861:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.228058:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796643328 00000100:00100000:3.0:1790772667.228072:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796643328 00000100:00100000:3.0:1790772667.228143:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1790772667.228154:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+11:14397:x1877760796643328:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1790772667.228184:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772667.228212:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be2a20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d2c expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.228407:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.228426:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.228436:0:14327:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.228479:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.228519:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 11 pid: 14327 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772667.228534:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14327:1877760813411456:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772667.228668:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f39a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772667.234054:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.234213:0:14310:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796643456 00000100:00100000:1.0:1790772667.234287:0:14310:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796643456 00010000:00010000:1.0:1790772667.234358:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 12 pid: 14327 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772667.234471:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1790772667.234484:0:14310:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+12:2354:x1877760796643456:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772667.234504:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772667.234513:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 12 pid: 14327 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.234530:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 12 pid: 14327 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.234558:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:1.0:1790772667.234563:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.234575:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.234583:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.234605:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772667.235555:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be29fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d1e expref: 12 pid: 14327 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772667.235581:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1180e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14327:1877760813411456:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772667.235612:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.235623:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.235630:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.235661:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.235673:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.235683:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.238126:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.238164:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.238179:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772667.238195:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790772667.239943:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.239965:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.239973:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.239980:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772667.239986:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.239994:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.240014:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:3.0:1790772667.240017:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772667.240023:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.240030:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2a27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772667.240054:0:14327:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007066bb0c reply state 000000005cfff700 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772667.240083:0:14327:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790772667.240149:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9e00/0xd3c7635991be2a20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 14 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.240166:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 13 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.240173:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:3.0:1790772667.240175:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1790772667.240178:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8e00, rc 0) 00000100:00100000:3.0:1790772667.244121:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+14:14397:x1877760796643328:12345-192.168.201.34@tcp:101:bash.0 Request processed in 13062us (13369us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1790772667.244152:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00010000:00010000:0.0:1790772667.246971:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.246997:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.247006:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.247014:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8000 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772667.247030:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.247039:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.247079:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff932884a8d100) 00010000:00010000:0.0:1790772667.247083:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772667.247088:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.247095:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8000/0xd3c7635991be2a2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772667.248209:0:14310:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:2354:x1877760796643456:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 13716us (14161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772667.248240:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1790772667.274674:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.275053:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796643584 00000100:00100000:1.0:1790772667.275086:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796643584 00000100:00100000:1.0:1790772667.275166:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:1.0:1790772667.275178:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14397:x1877760796643584:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1790772667.275212:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772667.275251:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2a43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d33 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.275364:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.275389:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.275407:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772667.275633:0:16345:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790772667.275639:0:16345:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772667.275677:0:16345:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.275691:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.275726:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dae00/0xd3c7635991be2a43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d33 expref: 15 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.275755:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d33 expref: 14 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.275766:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:0.0:1790772667.275769:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772667.275774:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db800, rc 0) 00000100:00100000:0.0:1790772667.276088:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+14:14397:x1877760796643584:12345-192.168.201.34@tcp:101:bash.0 Request processed in 697us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772667.276099:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1790772667.288237:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.290176:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796643840 00000100:00100000:1.0:1790772667.290195:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796643840 00000100:00100000:1.0:1790772667.290295:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1790772667.290305:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+14:14397:x1877760796643840:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1790772667.291124:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+15:14397:x1877760796643840:12345-192.168.201.34@tcp:35:bash.0 Request processed in 816us (2899us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790772667.291133:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1790772667.438321:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.438728:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796644096 00000100:00100000:1.0:1790772667.438742:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796644096 00000100:00100000:1.0:1790772667.438825:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1790772667.438837:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+15:14407:x1877760796644096:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1790772667.438871:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772667.439162:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d3a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772667.439454:0:14325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790772667.439791:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d3a expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.439808:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:1.0:1790772667.439811:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772667.439817:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d3a expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772667.439834:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db400, rc 0) 00000100:00100000:1.0:1790772667.440262:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+16:14407:x1877760796644096:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1426us (1955us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790772667.440272:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1790772667.444208:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772667.445365:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796644352 00000100:00100000:1.0:1790772667.445389:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796644352 00000100:00100000:1.0:1790772667.445476:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1790772667.445488:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+16:14407:x1877760796644352:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1790772667.446261:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14407:x1877760796644352:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 773us (2065us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790772667.446272:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000040:00080000:2.0:1790772667.468124:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790772667.587024:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.587856:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796644608 00000100:00100000:3.0:1790772667.587871:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796644608 00000100:00100000:3.0:1790772667.587998:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1790772667.588011:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14410:x1877760796644608:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1790772667.588045:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772667.588074:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be2a5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d41 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.588205:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2a66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.588670:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.589190:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772667.589209:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790772667.589819:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be2a5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d41 expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.589845:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2a66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d41 expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772667.589856:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:3.0:1790772667.589860:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772667.589864:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9c00, rc 0) 00000100:00100000:3.0:1790772667.592517:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+19:14410:x1877760796644608:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 4405us (5403us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790772667.592531:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1790772667.605795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772667.606029:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772667.606089:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796644864 00000100:00100000:0.0:1790772667.606102:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796644864 00000100:00100000:0.0:1790772667.606179:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1790772667.606191:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+19:2355:x1877760796644864:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772667.606220:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772667.606250:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2a66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d41 expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772667.606274:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:0.0:1790772667.606279:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772667.606358:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+18:2355:x1877760796644864:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 168us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772667.606366:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1790772667.609066:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796644736 00000100:00100000:2.0:1790772667.609083:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796644736 00000100:00100000:2.0:1790772667.609212:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:2.0:1790772667.609225:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+18:14410:x1877760796644736:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1790772667.609314:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609345:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609359:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609406:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609415:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609855:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609865:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974da00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772667.609870:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.609911:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.610052:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772667.610055:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772667.610061:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772667.610068:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772667.610171:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+18:14410:x1877760796644736:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 946us (4390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772667.610180:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:3.0:1790772667.617082:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772667.617164:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796645120 00000100:00100000:0.0:1790772667.617177:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796645120 00000100:00100000:0.0:1790772667.617245:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1790772667.617257:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+18:14410:x1877760796645120:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772667.617817:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+19:14410:x1877760796645120:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 561us (747us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790772667.617827:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1790772668.136015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772668.136179:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796645376 00000100:00100000:2.0:1790772668.136193:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796645376 00000100:00100000:2.0:1790772668.136301:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1790772668.136314:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+19:14441:x1877760796645376:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1790772668.136354:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772668.136391:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d48 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.136524:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.136543:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.136556:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772668.136569:0:16345:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772668.136776:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2a7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d48 expref: 22 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.136796:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d48 expref: 21 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.136806:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772668.136810:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772668.136814:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974c200, rc 0) 00000100:00100000:2.0:1790772668.137127:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c0f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+21:14441:x1877760796645376:12345-192.168.201.34@tcp:101:cat.0 Request processed in 815us (1125us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790772668.137135:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1790772668.141094:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772668.141190:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772668.141238:0:14310:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796645760 00000100:00100000:1.0:1790772668.141250:0:14310:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796645760 00000100:00100000:1.0:1790772668.141352:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1790772668.141370:0:14310:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+21:2357:x1877760796645760:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772668.141394:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772668.141426:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d48 expref: 21 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.141451:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:1.0:1790772668.141457:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772668.141520:0:14310:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+20:2357:x1877760796645760:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 159us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772668.141529:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1790772668.142351:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796645632 00000100:00100000:2.0:1790772668.142358:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796645632 00000100:00100000:2.0:1790772668.142411:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1790772668.142419:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+20:14441:x1877760796645632:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:2.0:1790772668.142831:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+21:14441:x1877760796645632:12345-192.168.201.34@tcp:35:cat.0 Request processed in 412us (1751us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1790772668.142840:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00080000:3.0:1790772668.143080:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790772668.235226:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772668.335597:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.336019:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796646016 00000100:00100000:0.0:1790772668.336035:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796646016 00000100:00100000:0.0:1790772668.336114:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:0.0:1790772668.336126:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+21:14447:x1877760796646016:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1790772668.336184:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772668.336213:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2a90 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d4f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.336356:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2a97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.336384:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.336398:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772668.336412:0:14325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790772668.336796:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2a90 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d4f expref: 24 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.336833:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d4f expref: 23 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.336843:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:0.0:1790772668.336847:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772668.336850:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be400, rc 0) 00000100:00100000:0.0:1790772668.337155:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14447:x1877760796646016:12345-192.168.201.34@tcp:101:dd.0 Request processed in 1030us (1573us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790772668.337164:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1790772668.346971:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772668.348843:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796646272 00000100:00100000:2.0:1790772668.348861:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796646272 00000100:00100000:2.0:1790772668.348978:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1790772668.348991:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14447:x1877760796646272:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1790772668.349070:0:16345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790772668.349106:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be400/0xd3c7635991be2a97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d4f expref: 23 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.349165:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db800/0xd3c7635991be2a4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d33 expref: 22 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.349179:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772668.349184:0:16345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772668.349464:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.349721:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.349735:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772668.349797:0:16345:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790772668.349826:0:16345:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000014757cfb reply state 0000000050946676 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772668.349837:0:16345:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772668.350180:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+24:14447:x1877760796646272:12345-192.168.201.34@tcp:36:dd.0 Request processed in 1190us (3221us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790772668.350189:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000020:00080000:2.0:1790772668.350196:0:16345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772668.359237:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.359261:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.359270:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.359277:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974da00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772668.359283:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.359292:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.359312:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:1.0:1790772668.359343:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772668.359351:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772668.359357:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974da00/0xd3c7635991be2aa5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772668.503256:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.504133:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796646528 00000100:00100000:0.0:1790772668.504148:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796646528 00000100:00100000:0.0:1790772668.504234:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1790772668.504266:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14447:x1877760796646528:12345-192.168.201.34@tcp:35:dd.0 00000100:00100000:0.0:1790772668.504842:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+24:14447:x1877760796646528:12345-192.168.201.34@tcp:35:dd.0 Request processed in 576us (1596us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1790772668.504852:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1790772668.530469:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.530513:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.530548:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.530571:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.530594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772668.530617:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772668.530752:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796647040 00000100:00100000:2.0:1790772668.530765:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796647040 00000100:00100000:2.0:1790772668.530862:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1790772668.530897:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:2355:x1877760796647040:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1790772668.531030:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+11:2355:x1877760796647040:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772668.531039:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1790772668.531654:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796646656 00000100:00100000:1.0:1790772668.531661:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796646656 00000100:00100000:1.0:1790772668.531714:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:1.0:1790772668.531721:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2355:x1877760796646656:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772668.531760:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2355:x1877760796646656:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772668.531767:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:3.0:1790772668.532058:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796646912 00000100:00100000:3.0:1790772668.532064:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796646912 00000100:00100000:3.0:1790772668.532092:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796647168 00000100:00100000:3.0:1790772668.532095:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796647168 00000100:00100000:3.0:1790772668.532108:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796646784 00000100:00100000:3.0:1790772668.532111:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796646784 00000100:00100000:3.0:1790772668.532123:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796647296 00000100:00100000:3.0:1790772668.532126:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796647296 00000100:00100000:3.0:1790772668.532155:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1790772668.532162:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796646912:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772668.532210:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796646912:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 48us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772668.532217:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1790772668.532233:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772668.532240:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796647168:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772668.532267:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796647168:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772668.532273:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772668.532284:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1790772668.532290:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796646784:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772668.532336:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2355:x1877760796646784:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 46us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772668.532342:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1790772668.532356:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1790772668.532362:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796647296:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1790772668.532394:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2355:x1877760796647296:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772668.532400:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00080000:0.0:1790772668.532991:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772668.532998:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772668.533001:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772668.810951:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772668.811198:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796647424 00000100:00100000:3.0:1790772668.811213:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796647424 00000100:00100000:3.0:1790772668.811287:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1790772668.811300:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+24:14461:x1877760796647424:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:3.0:1790772668.811371:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772668.811463:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be2aac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d56 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811563:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811581:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811594:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811610:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811617:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811622:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811807:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811816:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.811824:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772668.811871:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790772668.812020:0:14326:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772668.812073:0:14326:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812088:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812098:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812106:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812113:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812119:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9c00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772668.812124:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812132:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812147:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:3.0:1790772668.812150:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772668.812156:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812162:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ab3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812177:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812194:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812201:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812206:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e8800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:3.0:1790772668.812209:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812215:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812224:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff932884a8d600) 00010000:00010000:3.0:1790772668.812227:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772668.812230:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812236:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2aba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812275:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be2aac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d56 expref: 26 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812290:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d56 expref: 25 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772668.812298:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:3.0:1790772668.812301:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772668.812346:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9800, rc 0) 00000100:00100000:3.0:1790772668.813656:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+25:14461:x1877760796647424:12345-192.168.201.34@tcp:101:stat.0 Request processed in 2349us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772668.813668:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1790772668.918127:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772668.918454:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796647680 00000100:00100000:2.0:1790772668.918468:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796647680 00000100:00100000:2.0:1790772668.918555:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1790772668.918567:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+25:14467:x1877760796647680:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:2.0:1790772668.918641:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772668.918687:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9800/0xd3c7635991be2ac1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d56 expref: 25 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.918716:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772668.918722:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772668.919089:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.919107:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772668.919119:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772668.919180:0:14327:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1790772668.919209:0:14327:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e0c14bb reply state 000000003aece4ac transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772668.919219:0:14327:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772668.919407:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+27:14467:x1877760796647680:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 841us (1294us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790772668.919434:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000020:00080000:2.0:1790772668.919440:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772668.923155:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.923180:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.923190:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.923198:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772668.923204:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.923214:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.923236:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:0.0:1790772668.923259:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772668.923265:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772668.923273:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c200/0xd3c7635991be2ac8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772669.131475:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772669.131508:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813411584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772669.131606:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772669.132019:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813411584 00000100:00100000:0.0:1790772669.132030:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813411584 00000100:00100000:0.0:1790772669.132116:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772669.132128:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813411584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772669.132178:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772669.132246:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1877760813411584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772669.132255:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772669.132373:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1877760813411584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772669.132534:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772669.203354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772669.218598:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796647808 00000100:00100000:2.0:1790772669.218620:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796647808 00000100:00100000:2.0:1790772669.218715:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1790772669.218729:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+26:14481:x1877760796647808:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:2.0:1790772669.218762:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772669.218793:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2acf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d5d expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219222:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219244:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219260:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219278:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219286:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219325:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219450:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219459:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219476:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772669.219525:0:16345:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1790772669.219531:0:16345:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772669.219558:0:16345:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219572:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219581:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219588:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219595:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219602:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772669.219607:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219622:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219636:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:2.0:1790772669.219639:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772669.219645:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219651:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2ad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219664:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219670:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219676:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219682:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772669.219684:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219690:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219697:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9328a1803900) 00010000:00010000:2.0:1790772669.219700:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772669.219703:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219719:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2add lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219758:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2acf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 28 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219772:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 27 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.219780:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772669.219782:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772669.219784:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d400, rc 0) 00000100:00100000:2.0:1790772669.220294:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+27:14481:x1877760796647808:12345-192.168.201.34@tcp:101:stat.0 Request processed in 1567us (16957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772669.220315:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00010000:00010000:3.0:1790772669.259239:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772669.411020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772669.411132:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796648064 00000100:00100000:2.0:1790772669.411147:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796648064 00000100:00100000:2.0:1790772669.411214:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1790772669.411226:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+27:14491:x1877760796648064:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1790772669.411255:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772669.411281:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d64 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772669.411428:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772669.411868:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2aeb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d64 expref: 29 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.411935:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:2.0:1790772669.411939:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772669.411946:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d64 expref: 29 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.411964:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d600, rc 0) 00000100:00100000:2.0:1790772669.412053:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+28:14491:x1877760796648064:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 829us (1047us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1790772669.412062:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1790772669.419161:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772669.419268:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796648320 00000100:00100000:0.0:1790772669.419281:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796648320 00000100:00100000:0.0:1790772669.419368:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1790772669.419381:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f043c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+28:14491:x1877760796648320:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1790772669.420984:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f043c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+29:14491:x1877760796648320:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1594us (2106us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790772669.420997:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1790772669.497577:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772669.497726:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796648576 00000100:00100000:3.0:1790772669.497737:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796648576 00000100:00100000:3.0:1790772669.497804:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1790772669.497816:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+29:14497:x1877760796648576:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1790772669.497852:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772669.497984:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be2af9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d6b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498144:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498156:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498163:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 30 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498169:0:14326:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498202:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 30 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498212:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 30 pid: 16345 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772669.498230:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14326:1877760813411712:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772669.498686:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.498693:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 30 pid: 14327 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772669.498700:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14326:1877760813411840:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772669.498730:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f39a600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772669.503149:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772669.505030:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796648704 00000100:00100000:0.0:1790772669.505049:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796648704 00010000:00010000:0.0:1790772669.505105:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 31 pid: 16345 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772669.505156:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1790772669.505168:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba605050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+31:2355:x1877760796648704:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772669.505208:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772669.505217:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 31 pid: 16345 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.505234:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 31 pid: 16345 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.505262:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:0.0:1790772669.505268:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.505279:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.505286:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772669.505371:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba605050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+31:2355:x1877760796648704:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 205us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772669.505379:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1790772669.505854:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772669.506190:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796648832 00000100:00100000:2.0:1790772669.506197:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796648832 00010000:00010000:2.0:1790772669.506221:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 31 pid: 14327 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772669.506253:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1790772669.506261:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+31:2355:x1877760796648832:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772669.506274:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772669.506279:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 31 pid: 14327 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.506290:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 31 pid: 14327 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.506314:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772669.506319:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.506338:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.506345:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.506382:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772669.506582:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2ae4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d5d expref: 31 pid: 16345 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772669.506589:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+31:2355:x1877760796648832:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 329us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772669.506596:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1790772669.506604:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14326:1877760813411712:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772669.506621:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2a35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d2c expref: 29 pid: 14327 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772669.506631:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93289ee8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14326:1877760813411840:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772669.506659:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.506670:0:14326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.506677:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772669.506716:0:14326:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1790772669.507025:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9a00/0xd3c7635991be2af9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 30 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.507044:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772669.507052:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:3.0:1790772669.507054:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790772669.507057:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8800, rc 0) 00000100:00100000:3.0:1790772669.507096:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+29:14497:x1877760796648576:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9283us (9534us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1790772669.507104:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1790772669.515975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772669.516494:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649088 00000100:00100000:2.0:1790772669.516510:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649088 00000100:00100000:2.0:1790772669.516598:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1790772669.516610:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+29:14497:x1877760796649088:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1790772669.517024:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.517048:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.517062:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772669.517122:0:14327:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1790772669.517141:0:14327:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f398bb08 reply state 00000000493ed9ac transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772669.517149:0:14327:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772669.517248:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+32:14497:x1877760796649088:12345-192.168.201.34@tcp:36:bash.0 Request processed in 640us (1290us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1790772669.517262:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000020:00080000:2.0:1790772669.517268:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790772669.520161:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:0.0:1790772669.520302:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.520317:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.520327:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.520335:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772669.520341:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.520358:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.520383:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:0.0:1790772669.520387:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772669.520394:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.520400:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772669.520488:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649216 00000100:00100000:2.0:1790772669.520499:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649216 00000100:00100000:2.0:1790772669.520555:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1790772669.520566:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+31:14497:x1877760796649216:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1790772669.520595:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772669.520615:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b15 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d72 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.520685:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b15 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d72 expref: 32 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.520699:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b15 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d72 expref: 32 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.520720:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772669.520724:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772669.520727:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d800, rc 0) 00000100:00100000:2.0:1790772669.520796:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+32:14497:x1877760796649216:12345-192.168.201.34@tcp:101:bash.0 Request processed in 231us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772669.520804:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1790772669.525573:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772669.525859:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649344 00000100:00100000:0.0:1790772669.526025:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649344 00000100:00100000:0.0:1790772669.526145:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1790772669.526158:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+32:14497:x1877760796649344:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772669.526188:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772669.526214:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2b1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d79 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.526382:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.526409:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 33 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.526420:0:14327:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.526474:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 33 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.526501:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 33 pid: 14326 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772669.526518:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9747800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14327:1877760813411968:192.168.201.34@tcp:104: 00000100:00100000:0.0:1790772669.526635:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328a04b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772669.529384:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772669.529589:0:14312:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649472 00000100:00100000:1.0:1790772669.529599:0:14312:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649472 00010000:00010000:1.0:1790772669.529642:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 34 pid: 14326 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772669.529699:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1790772669.529724:0:14312:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+34:2354:x1877760796649472:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772669.529742:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772669.529750:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 34 pid: 14326 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.529765:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 34 pid: 14326 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.529789:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:1.0:1790772669.529795:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.529806:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.529815:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.529837:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772669.529927:0:14312:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+34:2354:x1877760796649472:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 204us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772669.529936:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00010000:00010000:2.0:1790772669.531279:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8800/0xd3c7635991be2b00 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d6b expref: 33 pid: 14326 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772669.531316:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9747800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14327:1877760813411968:192.168.201.34@tcp:104: 00010000:00010000:2.0:1790772669.531540:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.531552:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.531559:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772669.531616:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790772669.531621:0:14327:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772669.531648:0:14327:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.531756:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2b1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d79 expref: 33 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.531775:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d79 expref: 32 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.531784:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772669.531787:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772669.531790:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bf400, rc 0) 00000100:00100000:2.0:1790772669.531995:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+32:14497:x1877760796649344:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5838us (6436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772669.532005:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1790772669.534970:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772669.535051:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649728 00000100:00100000:2.0:1790772669.535065:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649728 00000100:00100000:2.0:1790772669.535158:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1790772669.535170:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+32:14497:x1877760796649728:12345-192.168.201.34@tcp:103:bash.0 00010000:00010000:2.0:1790772669.535208:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790772669.535236:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf400/0xd3c7635991be2b23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d79 expref: 32 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.535260:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b15 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d72 expref: 31 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772669.535273:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff932884a8da00) 00010000:00010000:2.0:1790772669.535286:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772669.535691:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+30:14497:x1877760796649728:12345-192.168.201.34@tcp:103:bash.0 Request processed in 521us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772669.535700:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1790772669.538224:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772669.538526:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649856 00000100:00100000:1.0:1790772669.538539:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649856 00000100:00100000:1.0:1790772669.538601:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1790772669.538612:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+30:14497:x1877760796649856:12345-192.168.201.34@tcp:58:bash.0 00010000:00010000:1.0:1790772669.538807:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.538852:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772669.538865:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772669.540257:0:16345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772669.541501:0:16345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1790772669.541598:0:16345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1790772669.541825:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+30:14497:x1877760796649856:12345-192.168.201.34@tcp:58:bash.0 Request processed in 3208us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772669.541840:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1790772669.544075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772669.544193:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796649984 00000100:00100000:0.0:1790772669.544205:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796649984 00000100:00100000:0.0:1790772669.544305:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1790772669.544316:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+30:14497:x1877760796649984:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772669.544344:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772669.544379:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d80 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.544459:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.544473:0:14325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 31 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.544497:0:14325:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.544512:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 31 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.544546:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:0.0:1790772669.544550:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772669.544555:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 31 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772669.544563:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12be800, rc 0) 00000100:00100000:0.0:1790772669.544632:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+31:14497:x1877760796649984:12345-192.168.201.34@tcp:101:bash.0 Request processed in 317us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772669.544640:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1790772669.643526:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772669.643558:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813412096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772669.643652:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772669.643754:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412096 00000100:00100000:1.0:1790772669.643765:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412096 00000100:00100000:1.0:1790772669.643827:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772669.643837:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813412096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772669.643906:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772669.643961:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813412096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772669.643968:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1790772669.643998:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772669.644036:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813412096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772669.644755:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813412352:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.644795:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772669.644821:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772669.644826:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813412224:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.644852:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772669.644906:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412352 00000100:00100000:3.0:1790772669.644910:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412352 00000100:00100000:3.0:1790772669.644943:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772669.644952:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813412352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.644996:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813412352:12345-0@lo:400:kworker.0 Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772669.645003:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772669.645049:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813412352:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645290:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813412480:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645332:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772669.645362:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772669.645368:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813412608:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645493:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772669.645532:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772669.645540:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813412736:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645564:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772669.645595:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412480 00000100:00100000:3.0:1790772669.645599:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412480 00000100:00100000:3.0:1790772669.645622:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412608 00000100:00100000:3.0:1790772669.645624:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412608 00000100:00100000:3.0:1790772669.645654:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412736 00000100:00100000:3.0:1790772669.645657:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412736 00000100:00100000:3.0:1790772669.645825:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790772669.645832:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813412480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645872:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1877760813412480:12345-0@lo:400:kworker.0 Request processed in 40us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772669.645898:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790772669.645924:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1877760813412480:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645942:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772669.645948:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813412608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.645982:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93289ee89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813412608:12345-0@lo:400:kworker.0 Request processed in 34us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772669.645988:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772669.646019:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813412608:0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.646037:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772669.646043:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813412736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772669.646073:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1877760813412736:12345-0@lo:400:kworker.0 Request processed in 30us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772669.646079:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772669.646096:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1877760813412736:0@lo:400:kworker.0 00000100:00080000:1.0:1790772669.647242:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772669.648604:0:14320:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412224 00000100:00100000:0.0:1790772669.648620:0:14320:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412224 00000100:00100000:0.0:1790772669.648734:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790772669.648745:0:14320:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3318:x1877760813412224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772669.648841:0:14320:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3318:x1877760813412224:12345-0@lo:400:kworker.0 Request processed in 98us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772669.648849:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790772669.651275:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d178e578-a8f2-4768-8767-0ddb2fe17697:3318:1877760813412224:0@lo:400:kworker.0 00010000:00010000:0.0:1790772670.285304:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772670.317111:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:3.0:1790772670.317168:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1790772670.317179:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000040:00080000:3.0:1790772670.539498:0:14358:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790772670.539511:0:14358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772670.539571:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790772670.539582:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790772670.539757:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14358:1877760813412864:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772670.539956:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff93288f39a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790772670.544360:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.544693:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14358:1877760813412864:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790772670.545075:0:14336:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796650112 00000100:00100000:0.0:1790772670.545085:0:14336:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796650112 00000100:00080000:1.0:1790772670.545243:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772670.545294:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1790772670.545307:0:14336:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650112:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790772670.545671:0:14336:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650112:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 366us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.545679:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1790772670.550808:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.552637:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796650240 00000100:00100000:2.0:1790772670.552655:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796650240 00000100:00100000:2.0:1790772670.552738:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1790772670.552749:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650240:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772670.554089:0:14327:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772670.555089:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650240:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 2334us (4287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772670.555101:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1790772670.563967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.564101:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796650368 00000100:00100000:0.0:1790772670.564134:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796650368 00000100:00100000:0.0:1790772670.564226:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:0.0:1790772670.564238:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650368:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790772670.564347:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.564368:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.564382:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565090:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565116:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565130:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565169:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565178:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565185:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772670.565232:0:14325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790772670.565237:0:14325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772670.565268:0:14325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565299:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565306:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565313:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.565320:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772670.565324:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566032:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566049:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff932899c35e00) 00010000:00010000:0.0:1790772670.566052:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772670.566057:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566064:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566080:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566086:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566093:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566106:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf200 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772670.566110:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566116:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566125:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff932899c35800) 00010000:00010000:0.0:1790772670.566127:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772670.566130:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566136:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566153:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566159:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566165:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566169:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bea00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772670.566172:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566177:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566197:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:0.0:1790772670.566200:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772670.566203:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.566209:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772670.567935:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650368:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 3688us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.567952:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1790772670.571667:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.582014:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796650624 00000100:00100000:2.0:1790772670.582034:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796650624 00000100:00100000:2.0:1790772670.582124:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1790772670.582137:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:14498:x1877760796650624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772670.582195:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772670.582222:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be2b4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d87 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582359:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582377:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582391:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772670.582404:0:16345:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772670.582732:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582741:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582749:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582756:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772670.582760:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582769:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582783:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:2.0:1790772670.582795:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772670.582801:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582808:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d800/0xd3c7635991be2b54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582864:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be2b4d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d87 expref: 12 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.582985:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff932899c35e00) 00010000:00010000:2.0:1790772670.582988:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772670.582993:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d000/0xd3c7635991be2b4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d87 expref: 12 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.583004:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d000, rc 0) 00000100:00100000:2.0:1790772670.583090:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+11:14498:x1877760796650624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 956us (11437us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1790772670.583098:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:1.0:1790772670.593498:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.593675:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796650752 00000100:00100000:2.0:1790772670.593689:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796650752 00000100:00100000:2.0:1790772670.593760:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1790772670.593773:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+11:14498:x1877760796650752:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772670.593827:0:14326:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772670.594015:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+11:14498:x1877760796650752:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 245us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772670.594024:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1790772670.597065:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.597925:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796651008 00000100:00100000:0.0:1790772670.597942:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796651008 00000100:00100000:0.0:1790772670.598026:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1790772670.598037:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+11:14498:x1877760796651008:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772670.598059:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772670.598082:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d8e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772670.599713:0:14327:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1790772670.599726:0:14327:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1790772670.600744:0:14327:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1790772670.601224:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.601243:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.601255:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.606580:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d8e expref: 14 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.606609:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d8e expref: 13 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.606619:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff932899c35800) 00010000:00010000:0.0:1790772670.606622:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772670.606625:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bf200, rc 0) 00000100:00100000:0.0:1790772670.606703:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796651008:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 8666us (9650us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790772670.606712:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1790772670.618180:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.618353:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796651264 00000100:00100000:0.0:1790772670.618366:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796651264 00000100:00100000:0.0:1790772670.618451:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1790772670.618463:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796651264:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772670.618545:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772670.618579:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2b69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d8e expref: 13 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.618602:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff932899c35800) 00010000:00010000:0.0:1790772670.618615:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772670.618641:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.618670:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.618696:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.618712:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.618720:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.618726:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619135:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619145:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619153:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619160:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bea00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772670.619166:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619174:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619183:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:0.0:1790772670.619186:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772670.619190:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619203:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bea00/0xd3c7635991be2b77 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619215:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619221:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619226:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619231:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772670.619234:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619240:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619248:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x55a46478 (ffff932899c35500) 00010000:00010000:0.0:1790772670.619250:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772670.619254:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.619260:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2b7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x55a46478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772670.619364:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+12:14498:x1877760796651264:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 901us (1197us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772670.619373:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1790772670.631319:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772670.631576:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796651392 00000100:00100000:1.0:1790772670.631591:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796651392 00000100:00100000:1.0:1790772670.631670:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1790772670.631682:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+12:14498:x1877760796651392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772670.631711:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772670.631742:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2b85 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d95 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.631791:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be2b8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.631809:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be2b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.631823:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be2b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.632021:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db400/0xd3c7635991be2b85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d95 expref: 14 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.632045:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4db600/0xd3c7635991be2b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d95 expref: 13 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.632067:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:1.0:1790772670.632070:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772670.632073:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328ba4db600, rc 0) 00000100:00100000:1.0:1790772670.632155:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796651392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 476us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772670.632163:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1790772670.637790:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.638975:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796651648 00000100:00100000:2.0:1790772670.638989:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796651648 00000100:00100000:2.0:1790772670.639066:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1790772670.639078:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796651648:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772670.639193:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.639217:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.639230:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772670.639830:0:14326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1790772670.639844:0:14326:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 491459967953ns, next at 492459964820ns, rc = 0 00000004:00010000:2.0:1790772670.639989:0:14326:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004fb92e34 reply state 000000001ed36706 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772670.640001:0:14326:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772670.640118:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+15:14498:x1877760796651648:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1040us (2342us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1790772670.640127:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00010000:00010000:0.0:1790772670.646354:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.646381:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.646391:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.646398:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974de00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772670.646405:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.646414:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.646450:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:0.0:1790772670.646455:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772670.646461:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.646467:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2b93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772670.647093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.647177:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796651776 00000100:00100000:2.0:1790772670.647191:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796651776 00000100:00100000:2.0:1790772670.647248:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1790772670.647258:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+14:14498:x1877760796651776:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772670.647300:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772670.647323:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50d9c expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.647427:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 15 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.647458:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 15 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.647479:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:2.0:1790772670.647482:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772670.647485:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328b974d600, rc 0) 00000100:00100000:2.0:1790772670.647555:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+15:14498:x1877760796651776:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 299us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772670.647563:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1790772670.653001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772670.658307:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796651904 00000100:00100000:3.0:1790772670.658421:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796651904 00000100:00100000:3.0:1790772670.658685:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1790772670.658701:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2354:x1877760796651904:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790772670.659232:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2354:x1877760796651904:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 534us (6240us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790772670.659241:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00080000:1.0:1790772670.674345:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772670.675099:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.675186:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796652160 00000100:00100000:0.0:1790772670.675198:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796652160 00000100:00100000:0.0:1790772670.675260:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1790772670.675269:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+15:14498:x1877760796652160:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790772670.675749:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+16:14498:x1877760796652160:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 480us (659us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790772670.675758:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1790772670.684503:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.684742:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796652416 00000100:00100000:0.0:1790772670.684756:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796652416 00000100:00100000:0.0:1790772670.684831:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1790772670.684842:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+16:14498:x1877760796652416:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772670.685027:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+16:14498:x1877760796652416:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 186us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.685036:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1790772670.687996:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772670.688404:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796652544 00000100:00100000:3.0:1790772670.688454:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796652544 00000100:00100000:3.0:1790772670.688529:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1790772670.688539:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+16:14498:x1877760796652544:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772670.688567:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772670.688595:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2ba1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50da3 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.688686:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ba8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.688704:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.688718:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772670.688768:0:16345:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772670.688796:0:16345:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.688827:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e8e00/0xd3c7635991be2ba1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50da3 expref: 18 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.688849:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50da3 expref: 17 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.688859:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:3.0:1790772670.688863:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790772670.688867:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9c00, rc 0) 00000100:00100000:3.0:1790772670.689362:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14498:x1877760796652544:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 822us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772670.689381:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:1.0:1790772670.694866:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772670.695116:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796652672 00000100:00100000:3.0:1790772670.695129:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796652672 00000100:00100000:3.0:1790772670.695192:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1790772670.695204:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+6:2355:x1877760796652672:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772670.695229:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772670.695259:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50daa expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772670.695303:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd05bf, blocks: 0x1 00010000:00010000:3.0:1790772670.695328:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1790772670.695333:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772670.695345:0:15011:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 7 pid: 15011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.695368:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 7 pid: 15011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.695384:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e9e00, rc 0) 00000100:00100000:3.0:1790772670.695470:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2355:x1877760796652672:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 268us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772670.695478:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1790772670.712599:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.712717:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796652928 00000100:00100000:0.0:1790772670.712731:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796652928 00000100:00100000:0.0:1790772670.712804:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1790772670.712816:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14498:x1877760796652928:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772670.713004:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14498:x1877760796652928:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 189us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.713012:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1790772670.719240:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.719567:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653056 00000100:00100000:2.0:1790772670.719582:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653056 00000100:00100000:2.0:1790772670.719655:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1790772670.719668:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14498:x1877760796653056:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790772670.783638:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1790772670.783828:0:5878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790772670.784092:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813412992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790772670.784188:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772670.784430:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813412992 00000100:00100000:0.0:1790772670.784547:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813412992 00000100:00100000:0.0:1790772670.784613:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772670.784624:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813412992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790772670.784831:0:15010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790772670.784835:0:15010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790772670.784838:0:15010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790772670.784840:0:15010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790772671 -> 1790772671 00002000:00010000:0.0:1790772670.784843:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790772670.784935:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1877760813412992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (746us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790772670.784944:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1790772670.785170:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9328b9744000/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790772670.785178:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813412992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772670.785557:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796653056:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 65887us (66329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772670.785570:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1790772670.793538:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.794452:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653184 00000100:00100000:0.0:1790772670.794472:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653184 00000100:00100000:0.0:1790772670.794563:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1790772670.794577:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2357:x1877760796653184:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790772670.794743:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2357:x1877760796653184:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 168us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.794752:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:1.0:1790772670.802599:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.802775:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653440 00000100:00100000:0.0:1790772670.802793:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653440 00000100:00100000:0.0:1790772670.802987:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:0.0:1790772670.802999:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796653440:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772670.803072:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772670.803108:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328bf5e9c00/0xd3c7635991be2ba8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50da3 expref: 13 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.803135:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:0.0:1790772670.803139:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772670.803179:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.803197:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.803208:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772670.803593:0:14326:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000001a31400 reply state 0000000051c56cc7 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772670.803625:0:14326:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772670.803762:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+14:14498:x1877760796653440:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 763us (1171us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1790772670.803770:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1790772670.810571:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772670.810644:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653568 00000100:00100000:3.0:1790772670.810659:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653568 00000100:00100000:3.0:1790772670.810728:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1790772670.810739:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:14498:x1877760796653568:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772670.810764:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772670.810789:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50db1 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.810829:0:15011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.810839:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772670.810843:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772670.810849:0:15011:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 8 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.810913:0:15011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.810930:0:15011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772670.810946:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15011:1877760813413120:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772670.811043:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff932898436180 going to sleep for 11 seconds 00010000:00010000:1.0:1790772670.811292:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.811304:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.811311:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.811330:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf800 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:1.0:1790772670.811337:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.811346:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.811363:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:1.0:1790772670.811366:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772670.811371:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.811378:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf800/0xd3c7635991be2bb6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772670.814616:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15011:1877760813413120:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772670.814667:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 8 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.814702:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328bf5e8e00, rc 0) 00000100:00100000:3.0:1790772670.814768:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+8:14498:x1877760796653568:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4030us (4211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772670.814777:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1790772670.817447:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772670.823123:0:14310:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653696 00000100:00100000:1.0:1790772670.823140:0:14310:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653696 00010000:00010000:1.0:1790772670.823194:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772670.823246:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1790772670.823257:0:14310:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+8:2354:x1877760796653696:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772670.823502:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772670.823528:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.823544:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.823586:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2baf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50daa expref: 8 pid: 15011 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.823605:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772670.823609:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772670.823616:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 7 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.823628:0:14310:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 7 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.823734:0:14310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 7 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772670.823750:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328ba714700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14310:1877760813413248:192.168.201.34@tcp:105: 00000100:00100000:1.0:1790772670.823844:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff932886c68180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772670.826921:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328ba714700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14310:1877760813413248:192.168.201.34@tcp:105: 00010000:00010000:3.0:1790772670.826949:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772670.827002:0:14310:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2354:x1877760796653696:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 3748us (9563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772670.827013:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772670.834775:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772670.836513:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653824 00000100:00100000:3.0:1790772670.836527:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653824 00000100:00100000:3.0:1790772670.836598:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1790772670.836609:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2354:x1877760796653824:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790772670.836834:0:15010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790772670.836838:0:15010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790772669 00002000:00010000:3.0:1790772670.836840:0:15010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790772667 00002000:00010000:3.0:1790772670.836843:0:15010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790772671 -> 1790772669 00002000:00010000:3.0:1790772670.836845:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790772670.836943:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+8:2354:x1877760796653824:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 334us (2176us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790772670.836951:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1790772670.856768:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1790772670.856940:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796653952 00000100:00100000:3.0:1790772670.856949:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796653952 00000100:00100000:3.0:1790772670.857021:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1790772670.857031:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+8:2355:x1877760796653952:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790772670.857074:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.857109:0:15011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 8 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.857119:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772670.857125:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772670.857130:0:15011:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.857167:0:15011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 8 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.857181:0:15011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 8 pid: 15011 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772670.857194:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15011:1877760813413376:192.168.201.34@tcp:104: 00000100:00100000:3.0:1790772670.857310:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff932898436180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772670.865970:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.866207:0:14311:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796654080 00000100:00100000:2.0:1790772670.866245:0:14311:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796654080 00010000:00010000:2.0:1790772670.866327:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 9 pid: 15011 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772670.866385:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1790772670.866397:0:14311:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:2355:x1877760796654080:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772670.866416:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772670.866456:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 9 pid: 15011 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.866474:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 9 pid: 15011 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.866508:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772670.866514:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772670.866522:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.866535:0:14311:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.866560:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772670.866648:0:14311:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+9:2355:x1877760796654080:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 237us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772670.866657:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:0.0:1790772670.868044:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b52e4bc/0xd3c7635991be2bbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db1 expref: 8 pid: 15011 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772670.868069:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15011:1877760813413376:192.168.201.34@tcp:104: 00010000:00010000:0.0:1790772670.868103:0:15011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868117:0:15011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868126:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868736:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868749:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868759:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868793:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328bf5e9e00 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:0.0:1790772670.868798:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.868977:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.869001:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.869011:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc1fa60/0xd3c7635991be2bc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772670.869120:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:2355:x1877760796653952:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 12089us (12361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.869132:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1790772670.878300:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.878548:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796654336 00000100:00100000:2.0:1790772670.878562:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796654336 00000100:00100000:2.0:1790772670.878660:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1790772670.878672:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+13:14498:x1877760796654336:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772670.878785:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.878819:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.878833:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.879197:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.879210:0:16345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 14 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.879220:0:16345:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.879263:0:16345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 14 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.879296:0:16345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 14 pid: 16345 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772670.879313:0:16345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1193100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1877760813413504:192.168.201.34@tcp:104: 00000100:00100000:2.0:1790772670.879421:0:16345:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772670.885635:0:16345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1193100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1877760813413504:192.168.201.34@tcp:104: 00010000:00010000:3.0:1790772670.885677:0:16345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772670.888731:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772670.891588:0:14310:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796654464 00000100:00100000:1.0:1790772670.891609:0:14310:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796654464 00010000:00010000:1.0:1790772670.891691:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 15 pid: 16345 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772670.891746:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1790772670.891757:0:14310:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+15:2355:x1877760796654464:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772670.891798:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772670.891816:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 15 pid: 16345 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.891832:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 15 pid: 16345 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.891861:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d600/0xd3c7635991be2b9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d9c expref: 15 pid: 16345 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.891901:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:1.0:1790772670.891907:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.891919:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.891928:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772670.891966:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772670.892046:0:14310:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+14:2355:x1877760796654464:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 290us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772670.892054:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00010000:00010000:3.0:1790772670.893094:0:16345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772670.893108:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772670.893350:0:16345:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1790772670.893655:0:16345:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1790772670.893706:0:16345:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1790772670.894669:0:16345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16345:1877760813413632:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790772670.894990:0:16345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772670.895039:0:16345:0:(client.c:2716:ptlrpc_set_wait()) set ffff9328aa8e8600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772670.896565:0:14330:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813413632 00000100:00100000:1.0:1790772670.896585:0:14330:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813413632 00000100:00100000:1.0:1790772670.896653:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790772670.896666:0:14330:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16345:x1877760813413632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790772670.896818:0:14330:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16345:x1877760813413632:12345-0@lo:1000:mdt00_003.0 Request processed in 154us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772670.896842:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772670.897051:0:16345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16345:1877760813413632:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790772670.898031:0:16345:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1790772670.898134:0:16345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16345:1877760813413760:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790772670.898198:0:16345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772670.898232:0:16345:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83540 going to sleep for 11 seconds 00000100:00100000:1.0:1790772670.898604:0:14330:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813413760 00000100:00100000:1.0:1790772670.898612:0:14330:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813413760 00000100:00100000:1.0:1790772670.898656:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772670.898665:0:14330:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16345:x1877760813413760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790772670.898892:0:14330:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16345:x1877760813413760:12345-0@lo:1000:mdt00_003.0 Request processed in 212us (677us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790772670.898901:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772670.899769:0:16345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1191f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16345:1877760813413760:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790772670.899824:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899836:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899845:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899852:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974c600 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772670.899859:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899868:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899907:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:2.0:1790772670.899910:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772670.899915:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899922:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974c600/0xd3c7635991be2bd2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899961:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899985:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899992:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.899998:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328ba4dbc00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772670.900001:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.900007:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.900016:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:2.0:1790772670.900019:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772670.900027:0:16345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.900040:0:16345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.900051:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.900089:0:16345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12be800/0xd3c7635991be2b31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50d80 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772670.900105:0:16345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328c1193100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1877760813413888:192.168.201.34@tcp:105: 00000100:00100000:2.0:1790772670.900215:0:16345:0:(client.c:2716:ptlrpc_set_wait()) set ffff93289ed83540 going to sleep for 11 seconds 00000100:00100000:2.0:1790772670.905701:0:16345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328c1193100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1877760813413888:192.168.201.34@tcp:105: 00010000:00010000:2.0:1790772670.905742:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905755:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328ba4dbc00/0xd3c7635991be2b2a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905796:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905813:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905826:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905838:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905845:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905852:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905859:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974de00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772670.905864:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905871:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905946:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:2.0:1790772670.905950:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772670.905954:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905960:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974de00/0xd3c7635991be2bd9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905971:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905977:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905983:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905989:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328b974d400 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:2.0:1790772670.905992:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.905998:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.906005:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:2.0:1790772670.906007:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772670.906009:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.906015:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328b974d400/0xd3c7635991be2bcb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772670.906746:0:14358:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790772670.906753:0:14358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772670.906780:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790772670.906787:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790772670.907037:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14498:x1877760796654336:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 28364us (28747us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1790772670.907050:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000020:00080000:2.0:1790772670.907058:0:16345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1790772670.926165:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.926788:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796654592 00000100:00100000:0.0:1790772670.926801:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796654592 00000100:00100000:0.0:1790772670.926921:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1790772670.926934:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14497:x1877760796654592:12345-192.168.201.34@tcp:49:bash.0 00000100:00100000:0.0:1790772670.927112:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14497:x1877760796654592:12345-192.168.201.34@tcp:49:bash.0 Request processed in 180us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.927121:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1790772670.927920:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.928031:0:14329:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796654848 00000100:00100000:0.0:1790772670.928054:0:14329:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796654848 00000100:00100000:0.0:1790772670.928087:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1790772670.928095:0:14329:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+17:14498:x1877760796654848:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790772670.931194:0:14329:0:(mdd_object.c:4189:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790772670.931528:0:14329:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1790772670.931623:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.931646:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.931660:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.931669:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.931675:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.931681:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.931710:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790772670.931840:0:14329:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+19:14498:x1877760796654848:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 3740us (3916us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1790772670.931851:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000020:00080000:0.0:1790772670.931858:0:14329:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790772670.932589:0:15493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772670.932600:0:15493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.932609:0:15493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bf200 already unused, calling callback (ffffffffc1501ac0) 00010000:00010000:2.0:1790772670.932614:0:15493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.932624:0:15493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.932639:0:15493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9328a16c3b00) 00010000:00010000:2.0:1790772670.932642:0:15493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790772670.932646:0:15493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.932653:0:15493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bf200/0xd3c7635991be2be0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772670.932668:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772670.932669:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772670.932671:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772670.932973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772670.934767:0:15010:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796654976 00000100:00100000:0.0:1790772670.934784:0:15010:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796654976 00000100:00100000:0.0:1790772670.935519:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1790772670.935552:0:15010:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+7:14497:x1877760796654976:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1790772670.935576:0:15010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772670.935605:0:15010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be2be7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50db8 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772670.935637:0:15010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abd05bd, atime: 0x6abd05bb, ctime: 0x6abd05bd, blocks: 0x1 00010000:00010000:0.0:1790772670.935662:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:0.0:1790772670.935668:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772670.935679:0:15010:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be2be7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db8 expref: 8 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.935697:0:15010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b45fbbd7/0xd3c7635991be2be7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50db8 expref: 8 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772670.935711:0:15010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bf400, rc 0) 00000100:00100000:0.0:1790772670.935800:0:15010:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+8:14497:x1877760796654976:12345-192.168.201.34@tcp:101:bash.0 Request processed in 252us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772670.948738:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1790772670.951170:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772670.951303:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796655232 00000100:00100000:2.0:1790772670.951313:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796655232 00000100:00100000:2.0:1790772670.951382:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1790772670.951392:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+19:14497:x1877760796655232:12345-192.168.201.34@tcp:35:bash.0 00000001:00080000:2.0:1790772670.951668:0:14328:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1790772670.951760:0:14328:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1790772670.951868:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+22:14497:x1877760796655232:12345-192.168.201.34@tcp:35:bash.0 Request processed in 476us (707us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1790772670.951918:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000020:00080000:2.0:1790772670.951924:0:14328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790772671.185976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772671.186073:0:14327:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796655488 00000100:00100000:0.0:1790772671.186085:0:14327:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796655488 00000100:00100000:0.0:1790772671.186149:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1790772671.186159:0:14327:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+22:14508:x1877760796655488:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1790772671.186184:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772671.186204:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc2bb618838a50dbf expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772671.186512:0:14327:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790772671.186626:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50dbf expref: 24 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.186752:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9328a1803e00) 00010000:00010000:0.0:1790772671.186755:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772671.186761:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc2bb618838a50dbf expref: 24 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.186776:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9328c12bec00, rc 0) 00000100:00100000:0.0:1790772671.186842:0:14327:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328c1193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14508:x1877760796655488:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 684us (876us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1790772671.186850:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:2.0:1790772671.202595:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772671.202758:0:14325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796655616 00000100:00100000:0.0:1790772671.202768:0:14325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796655616 00000100:00100000:0.0:1790772671.202827:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:0.0:1790772671.202836:0:14325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bf629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14508:x1877760796655616:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1790772671.202948:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.202967:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.202981:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.202996:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203017:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203024:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203253:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203262:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203279:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772671.203574:0:14325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203588:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203595:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203602:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203607:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bec00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772671.203611:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.203618:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204112:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff932884a8de00) 00010000:00010000:0.0:1790772671.204116:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772671.204122:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204129:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bec00/0xd3c7635991be2bfc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204145:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204152:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204157:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204162:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfc00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772671.204165:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204170:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204178:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff932899c35b00) 00010000:00010000:0.0:1790772671.204180:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772671.204183:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204189:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfc00/0xd3c7635991be2c03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204218:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204224:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204230:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204235:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9328c12bfe00 already unused, calling callback (ffffffffc1f764f0) 00010000:00010000:0.0:1790772671.204238:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204245:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204252:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9328a16c3100) 00010000:00010000:0.0:1790772671.204254:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772671.204257:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772671.204262:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9328c12bfe00/0xd3c7635991be2c0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772671.204777:0:14325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bf629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14508:x1877760796655616:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1938us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772671.204788:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1790772671.224193:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772671.226276:0:14328:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796655872 00000100:00100000:2.0:1790772671.226291:0:14328:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796655872 00000100:00100000:2.0:1790772671.226538:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1790772671.226550:0:14328:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+23:14508:x1877760796655872:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1790772671.227039:0:14328:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+24:14508:x1877760796655872:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 490us (2855us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1790772671.227048:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:3.0:1790772671.309816:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772672.334711:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772673.356294:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772673.650540:0:16595:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1790772673.655854:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772673.655927:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772673.655950:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772673.655995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1790772673.656056:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656384 00000100:00100000:2.0:1790772673.656065:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656384 00002000:00100000:2.0:1790772673.656127:0:15014:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9328bfd88a80 x1877760796656384/t0(0) o4->c2c98cc0-3117-4d23-8350-1bdc44edcae4@192.168.201.34@tcp:264/0 lens 504/0 e 0 to 0 dl 1790772684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1790772673.656140:0:15014:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328bfd88a80 with x1877760796656384 ext(0->8) 00002000:00010000:2.0:1790772673.656146:0:15014:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328bfd88a80 00000100:00100000:2.0:1790772673.656179:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1790772673.656188:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+8:2356:x1877760796656384:12345-192.168.201.34@tcp:4:bash.0 00000100:00100000:2.0:1790772673.656704:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:2356:x1877760796656384:12345-192.168.201.34@tcp:4:bash.0 Request processed in 508us (744us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1790772673.656714:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:2.0:1790772673.656722:0:15014:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9328bfd88a80 x1877760796656384/t8589934598(0) o4->c2c98cc0-3117-4d23-8350-1bdc44edcae4@192.168.201.34@tcp:264/0 lens 504/448 e 0 to 0 dl 1790772684 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1790772673.656730:0:15014:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9328bfd88a80 with x1877760796656384 ext(0->8) 00002000:00010000:2.0:1790772673.656734:0:15014:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9328bfd88a80 00000100:00100000:2.0:1790772673.656762:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656512 00000100:00100000:2.0:1790772673.656766:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656512 00000100:00100000:2.0:1790772673.656795:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1790772673.656803:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:2356:x1877760796656512:12345-192.168.201.34@tcp:16:kworker.0 00000100:00100000:0.0:1790772673.657353:0:14317:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656000 00000100:00100000:0.0:1790772673.657359:0:14317:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656000 00000100:00100000:0.0:1790772673.657400:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:0.0:1790772673.657407:0:14317:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2355:x1877760796656000:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1790772673.657443:0:14317:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e31b6460-4591-4d63-a470-ddffcd27dc7d+13:2355:x1877760796656000:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 36us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772673.657449:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:1.0:1790772673.658778:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656128 00000100:00100000:1.0:1790772673.658800:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656128 00000100:00100000:1.0:1790772673.658859:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1790772673.658869:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328bfd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+24:2355:x1877760796656128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772673.658958:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c98cc0-3117-4d23-8350-1bdc44edcae4+24:2355:x1877760796656128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 90us (3029us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772673.658965:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00080000:1.0:1790772673.658987:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772673.658992:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772673.661465:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772673.661500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772673.661522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1790772673.661544:0:15010:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790772673.661552:0:15010:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790772673.667829:0:15008:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790772673.667858:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656256 00000100:00100000:0.0:1790772673.667869:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656256 00000100:00100000:0.0:1790772673.667942:0:15008:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790772673.667949:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656768 00000100:00100000:0.0:1790772673.667952:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656768 00000100:00100000:0.0:1790772673.667965:0:15008:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790772673.667970:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656896 00000100:00100000:0.0:1790772673.667972:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656896 00000100:00100000:0.0:1790772673.676904:0:16596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1790772673.676926:0:16596:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+5:2353:x1877760796656256:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:0.0:1790772673.676960:0:16596:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be289f 00000100:00080000:0.0:1790772673.676978:0:16596:0:(import.c:65:import_set_state_nolock()) ffff9328bf5f6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772673.677040:0:16596:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1790772673.677509:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772673.677604:0:16596:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2c98cc0-3117-4d23-8350-1bdc44edcae4+2:2353:x1877760796656256:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 685us (16146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772673.677613:0:16596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1790772673.677645:0:16596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772673.677654:0:16596:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2353:x1877760796656768:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:0.0:1790772673.677685:0:16596:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be28d0 00000100:00080000:0.0:1790772673.677691:0:16596:0:(import.c:65:import_set_state_nolock()) ffff93288f258000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790772673.677720:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790772673.677735:0:16596:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1790772673.680467:0:16596:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+2:2353:x1877760796656768:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 2801us (18953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772673.680484:0:16596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1790772673.680528:0:16596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1790772673.680544:0:16596:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+5:2353:x1877760796656896:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:0.0:1790772673.680575:0:16596:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd3c7635991be28d7 00000100:00080000:0.0:1790772673.680597:0:16596:0:(import.c:65:import_set_state_nolock()) ffff932891903800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772673.680672:0:16596:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00010000:00010000:2.0:1790772673.680923:0:15493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772673.684629:0:16596:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+2:2353:x1877760796656896:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 4083us (23094us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772673.684644:0:16596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00080000:0.0:1790772673.690525:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772673.690537:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772673.723963:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1790772673.723998:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760796656640 00000100:00100000:1.0:1790772673.724008:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760796656640 00000100:00100000:1.0:1790772673.724065:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1790772673.724075:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2354:x1877760796656640:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1790772673.724153:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328ba716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5ec432-f248-4c90-9fe0-f28cd1c978c8+6:2354:x1877760796656640:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772673.724160:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00080000:0.0:1790772673.728412:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772673.873571:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328bfd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c98cc0-3117-4d23-8350-1bdc44edcae4+10:2356:x1877760796656512:12345-192.168.201.34@tcp:16:kworker.0 Request processed in 216759us (217565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772673.873587:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000001:00080000:2.0:1790772673.873632:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1790772673.873645:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1790772673.873653:0:7658:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:3.0:1790772674.251240:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813414016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772674.252102:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772674.253836:0:15012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414016 00000100:00100000:0.0:1790772674.253851:0:15012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414016 00000100:00100000:0.0:1790772674.254164:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790772674.254176:0:15012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813414016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772674.254212:0:15012:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772674.254519:0:15012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1877760813414016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 344us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772674.254527:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1790772674.255105:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772674.255483:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1877760813414016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790772674.384804:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790772674.473899:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad5ec432-f248-4c90-9fe0-f28cd1c978c8 00000020:00000080:3.0:1790772674.473907:0:6730:0:(genops.c:885:class_export_put()) final put ffff9328bf5f2800/ad5ec432-f248-4c90-9fe0-f28cd1c978c8 00000001:00100000:3.0:1790772674.473939:0:6730:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2c98cc0-3117-4d23-8350-1bdc44edcae4 00000020:00000080:3.0:1790772674.473942:0:6730:0:(genops.c:885:class_export_put()) final put ffff9328bf5f2000/c2c98cc0-3117-4d23-8350-1bdc44edcae4 00000020:00000080:2.0:1790772674.474101:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf5f2800/ad5ec432-f248-4c90-9fe0-f28cd1c978c8 for lustre-OST0000 00000020:00000080:2.0:1790772674.474154:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9328bf5f2000/c2c98cc0-3117-4d23-8350-1bdc44edcae4 for lustre-OST0000 00000020:00000080:2.0:1790772674.474168:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93288f258000 for lustre-OST0000 00000020:00000080:2.0:1790772674.474174:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9328bf5f6000 for lustre-OST0000 00000100:00100000:3.0:1790772674.764042:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813414400:0@lo:400:kworker.0 00000100:00100000:3.0:1790772674.764117:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772674.764187:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772674.764193:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813414272:0@lo:400:kworker.0 00000100:00100000:3.0:1790772674.764237:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772674.764284:0:14326:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414400 00000100:00100000:3.0:1790772674.764292:0:14326:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414400 00000100:00100000:3.0:1790772674.764333:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772674.764342:0:14326:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813414400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772674.764394:0:14326:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1877760813414400:12345-0@lo:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772674.764401:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772674.764440:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1877760813414400:0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.764819:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414272 00000100:00100000:0.0:1790772674.764824:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414272 00000100:00100000:0.0:1790772674.764905:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790772674.764923:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813414272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.764971:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813414272:12345-0@lo:400:kworker.0 Request processed in 59us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772674.764978:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790772674.765008:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1790772674.765013:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9328b9744000, transno 8589934595 00000004:00080000:0.0:1790772674.765023:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1790772674.765039:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813414272:0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765420:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813414528:0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765455:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772674.765481:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790772674.765486:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d178e578-a8f2-4768-8767-0ddb2fe17697:3315:1877760813414144:0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765514:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772674.765540:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93288f3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813414656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765560:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772674.765585:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414528 00000100:00100000:0.0:1790772674.765590:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414528 00000100:00100000:0.0:1790772674.765616:0:16345:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414656 00000100:00100000:0.0:1790772674.765619:0:16345:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414656 00000100:00100000:0.0:1790772674.765638:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772674.765645:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813414528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765682:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1877760813414528:12345-0@lo:400:kworker.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772674.765688:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772674.765712:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772674.765717:0:16345:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b9744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813414656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765746:0:16345:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b9744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1877760813414656:12345-0@lo:400:kworker.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772674.765752:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772674.765787:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1877760813414656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772674.765797:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1877760813414528:0@lo:400:kworker.0 00000100:00080000:2.0:1790772674.766102:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772674.766109:0:14321:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772674.766122:0:14319:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414144 00000100:00100000:2.0:1790772674.766127:0:14319:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414144 00000100:00100000:2.0:1790772674.766161:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790772674.766169:0:14319:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9328b8db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3315:x1877760813414144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772674.766232:0:14319:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9328b8db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d178e578-a8f2-4768-8767-0ddb2fe17697+19:3315:x1877760813414144:12345-0@lo:400:kworker.0 Request processed in 64us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772674.766238:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790772674.766291:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93288f3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d178e578-a8f2-4768-8767-0ddb2fe17697:3315:1877760813414144:0@lo:400:kworker.0 00000100:00100000:3.0:1790772674.768152:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772674.768172:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9328b9744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813414784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772674.768261:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772674.768538:0:15013:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760813414784 00000100:00100000:0.0:1790772674.768546:0:15013:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760813414784 00000100:00100000:0.0:1790772674.768595:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790772674.768603:0:15013:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93288f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813414784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772674.768624:0:15013:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1790772674.768676:0:15013:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93288f3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1877760813414784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772674.768682:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772674.768859:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9328b9744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1877760813414784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772675.405382:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790772675.841157:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000001:00080000:1.0:1790772675.841199:0:5878:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1790772675.841217:0:5878:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93289ed83480 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:1.0:1790772675.841223:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328b171cc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93289ed83780 00000020:00080000:1.0:1790772675.841226:0:5878:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9328b171c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff932782a47000 00000020:00080000:3.0:1790772675.841345:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:3.0:1790772675.841524:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 Debug log: 30059 lines, 30059 kept, 0 dropped, 0 bad.